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Preface 


Historically, much of theoretical neuroscience research concerned neuronal circuits and 
synaptic organization. The neurons were divided into excitatory and inhibitory types, 
but their electrophysiological properties were largely neglected or taken to be identical 
to those of Hodgkin-Huxley’s squid axon. The present awareness of the importance of 
the electrophysiology of individual neurons is best summarized by David McCormick 
in the fifth edition of Gordon Shepherd’s book The Synaptic Organization of the Brain: 


Information-processing depends not only on the anatomical substrates of synap- 
tic circuits but also on the electrophysiological properties of neurons... Even if 
two neurons in different regions of the nervous system possess identical morpho- 
logical features, they may respond to the same synaptic input in very different 
manners because of each cell’s intrinsic properties. 

McCormick (2004) 

Much of present neuroscience research concerns voltage- and second-messenger- 
gated currents in individual cells, with the goal of understanding the cell’s intrinsic 
neurocomputational properties. It is widely accepted that knowing the currents suffices 
to determine what the cell is doing and why it is doing it. This, however, contradicts a 
half-century—old observation that cells having similar currents can nevertheless exhibit 
quite different dynamics. Indeed, studying isolated axons having presumably similar 
electrophysiology (all are from the crustacean Carcinus maenas), Hodgkin (1948) in- 
jected a DC-current of varying amplitude, and discovered that some preparations could 
exhibit repetitive spiking with arbitrarily low frequencies, while the others discharged 
in a narrow frequency band. This observation was largely ignored by the neuroscience 
community until the seminal paper by Rinzel and Ermentrout (1989), who showed that 
the difference in behavior is due to different bifurcation mechanisms of excitability. 

Let us treat the amplitude of the injected current in Hodgkin’s experiments as a 
bifurcation parameter: When the amplitude is small, the cell is quiescent; when the 
amplitude is large, the cell fires repetitive spikes. When we change the amplitude of the 
injected current, the cell undergoes a transition from quiescence to repetitive spiking. 
From the dynamical systems point of view, the transition corresponds to a bifurcation 
from equilibrium to a limit cycle attractor. The type of bifurcation determines the most 
fundamental computational properties of neurons, such as the class of excitability, the 
existence or nonexistence of threshold, all-or-none spikes, subthreshold oscillations, 
the ability to generate postinhibitory rebound spikes, bistability of resting and spiking 
states, whether the neuron is an integrator or a resonator, and so on. 

This book is devoted to a systematic study of the relationship between electrophysi- 
ology, bifurcations, and computational properties of neurons. The reader will learn why 
cells having nearly identical currents may undergo distinct bifurcations, and hence they 
will have fundamentally different neurocomputational properties. (Conversely, cells 
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having quite different currents may undergo identical bifurcations, and hence they will 
have similar neurocomputational properties.) The major message of the book can be 
summarized as follows (compare with the McCormick statement above): 
Information-processing depends not only on the electrophysiological properties 
of neurons but also on their dynamical properties. Even if two neurons in the 
same region of the nervous system possess similar electrophysiological features, 
they may respond to the same synaptic input in very different manners because 
of each cell’s bifurcation dynamics. 


Nonlinear dynamical system theory is a core of computational neuroscience research, 
but it is not a standard part of the graduate neuroscience curriculum. Neither is it 
taught in most math/physics departments in a form suitable for a general biological 
audience. As a result, many neuroscientists fail to grasp such fundamental concepts as 
equilibrium, stability, limit cycle attractor, and bifurcations, even though neuroscien- 
tists constantly encounter these nonlinear phenomena. 

This book introduces dynamical systems starting with simple one- and two-dimen- 
sional spiking models and continuing all the way to bursting systems. Each chapter 
is organized from simple to complex, so everybody can start reading the book; only 
the reader’s background will determine where he or she stops. The book emphasizes 
the geometrical approach, so there are few equations but a lot of figures. Half of them 
are simulations of various neural models, so there are hundreds of possible exercises 
such as “Use MATLAB (GENESIS, NEURON, XPPAUT, etc.) and parameters in the 
caption of figure X to simulate the figure.” Additional problems are provided at the 
end of each chapter; the reader is encouraged to solve at least some of them and to 
look at the solutions of the others at the end of the book. Problems marked [M.S.] or 
[Ph.D.] are suggested thesis topics. 
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Chapter 1 


Introduction 


This chapter highlights some of the most important concepts developed in the book. 
First, we discuss several common misconceptions regarding the spike generation mech- 
anism of neurons. Our goal is to motivate the reader to think of a neuron not only 
in terms of ions and channels, as many biologists do, and not only in terms of an in- 
put/output relationship, as many theoreticians do, but also as a nonlinear dynamical 
system that looks at the input through the prism of its own intrinsic dynamics. We 
ask such questions as “What makes a neuron fire?” or “Where is the threshold?” , and 
then outline the answers, using the geometrical theory of dynamical systems. 

From a dynamical systems point of view, neurons are excitable because they are 
near a transition, called bifurcation, from resting to sustained spiking activity. While 
there is a huge number of possible ionic mechanisms of excitability and spike genera- 
tion, there are only four bifurcation mechanisms that can result in such a transition. 
Considering the geometry of phase portraits at these bifurcations, we can understand 
many computational properties of neurons, such as the nature of threshold and all-or- 
none spiking, the coexistence of resting and spiking states, the origin of spike latencies, 
postinhibitory spikes, and the mechanism of integration and resonance. Moreover, we 
can understand how these properties are interrelated, why some are equivalent, and 
why some are mutually exclusive. 


1.1 Neurons 


If somebody were to put a gun to the head of the author of this book and ask him to 
name the single most important concept in brain science, he would say it is the concept 
of a neuron. There are only 10! or so neurons in the human brain, much fewer than 
the number of non-neural cells such as glia. Yet neurons are unique in the sense that 
only they can transmit electrical signals over long distances. From the neuronal level 
we can go down to cell biophysics and to the molecular biology of gene regulation. 
From the neuronal level we can go up to neuronal circuits, to cortical structures, to 
the whole brain, and finally to the behavior of the organism. So let us see how much 
we understand of what is going on at the level of individual neurons. 
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Figure 1.1: Two interconnected cortical pyramidal neurons (hand drawing) and in vitro 
recorded spike. 


1.1.1 What Is a Spike? 


A typical neuron receives inputs from more than 10, 000 other neurons through the con- 
tacts on its dendritic tree called synapses; see Fig.1.1. The inputs produce electrical 
transmembrane currents that change the membrane potential of the neuron. Synaptic 
currents produce changes, called postsynaptic potentials (PSPs). Small currents pro- 
duce small PSPs; larger currents produce significant PSPs that can be amplified by the 
voltage-sensitive channels embedded in the neuronal membrane and lead to the gen- 
eration of an action potential or spike — an abrupt and transient change of membrane 
voltage that propagates to other neurons via a long protrusion called an axon. 

Such spikes are the main means of communication between neurons. In general, 
neurons do not fire on their own; they fire as a result of incoming spikes from other 
neurons. One of the most fundamental questions of neuroscience is What, exactly, 
makes neurons fire? What is it in the incoming pulses that elicits a response in one 
neuron but not in another? Why can two neurons have different responses to exactly 
the same input and identical responses to completely different inputs? To answer these 
questions, we need to understand the dynamics of spike generation mechanisms of 
neurons. 

Most introductory neuroscience books describe neurons as integrators with a thresh- 
old: neurons sum incoming PSPs and “compare” the integrated PSP with a certain 
voltage value, called the firing threshold. If it is below the threshold, the neuron re- 
mains quiescent; when it is above the threshold, the neuron fires an all-or-none spike, 
as in Fig.1.3, and resets its membrane potential. To add theoretical plausibility to this 
argument, the books refer to the Hodgkin-Huxley model of spike generation in squid 
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neurons do not fire, 
they get fired! 


Figure 1.2: What makes a neuron fire? 


giant axons, which we study in chapter 2. The irony is that the Hodgkin-Huxley model 
does not have a well-defined threshold; it does not fire all-or-none spikes; and it is not 
an integrator, but a resonator (i.e., it prefers inputs having certain frequencies that 
resonate with the frequency of subthreshold oscillations of the neuron). We consider 
these and other properties in detail in this book. 


1.1.2 Where Is the Threshold? 


Much effort has been spent trying to experimentally determine the firing thresholds 
of neurons. Here, we challenge the classical view of a threshold. Let us consider two 
typical experiments, depicted in Fig.1.4, that are designed to measure the threshold. 
in Fig.1.4a, we shock a cortical neuron (i.e., we inject brief but strong pulses of current 
of various amplitudes to depolarize the membrane potential to various values). Is there 
a clear-cut voltage value, as in Fig.1.3, above which the neuron fires but below which 
no spikes occur? If you find one, let the author know! In Fig.1.4b we inject long but 
weak pulses of current of various amplitudes, which results in slow depolarization and 
a spike. The firing threshold, if it exists, must be somewhere in the shaded region, but 
where? Where does the slow depolarization end and the spike start? Is it meaningful 
to talk about firing thresholds at all? 


all-or-none 
spikes 
Zr eee 
F ik : F 
resting BOS PIS Figure 1.3: The concept of a firing threshold. 
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Figure 1.4: Where is the firing threshold? Shown are in vitro recordings of two layer 5 
rat pyramidal neurons. Notice the differences of voltage and time scales. 


Figure 1.5: Where is the rheobase (i.e., the minimal current that fires the cell)? (a) 
in vitro recordings of the pyramidal neuron of layer 2/3 of a rat’s visual cortex show 
increasing latencies as the amplitude of the injected current decreases. (b) Simulation 
of the INa pt —model (pronounced: persistent sodium plus potassium model) shows 
spikes of graded amplitude. 


Perhaps, we should measure current thresholds instead of voltage thresholds. The 
current threshold (i.e., the minimal amplitude of injected current of infinite duration 
needed to fire a neuron) is called the rheobase. In Fig.1.5 we decrease the amplitudes 
of injected pulses of current to find the minimal one that still elicits a spike or the 
maximal one that does not. In Fig.1.5a, progressively weaker pulses result in longer 
latencies to the first spike. Eventually the neuron does not fire because the latency is 
longer than the duration of the pulse, which is 1 second in the figure. Did we really 
measure the neuronal rheobase? What if we waited a bit longer? How long is long 
enough? In Fig.1.5b the latencies do not grow, but the spike amplitudes decrease until 
the spikes do not look like spikes at all. To determine the current threshold, we need 
to draw the line and separate spike responses from “subthreshold” ones. How can we 
do that if the spikes are not all-or-none? Is the response denoted by the dashed line a 
spike? 

Risking adding more confusion to the notion of a threshold, consider the follow- 
ing. If excitatory inputs depolarize the membrane potential (i.e., bring it closer to 
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Figure 1.7: Resonant response of the mesencephalic V neuron of a rat’s brainstem to 
pulses of injected current having a 10 ms period (in vitro). 


the “firing threshold”), and inhibitory inputs hyperpolarize the potential and move it 
away from the threshold, then how can the neuron in Fig.1.6 fire in response to the 
inhibitory input? This phenomenon, also observed in the Hodgkin-Huxley model, is 
called anodal break excitation, rebound spike, or postinhibitory spike. | Many biolo- 
gists say that rebound responses are due to the activation and inactivation of certain 
slow currents, which bring the membrane potential over the threshold or, equivalently, 
lower the threshold upon release from the hyperpolarization — a phenomenon called a 
low-threshold spike in thalamocortical neurons. The problem with this explanation is 
that neither the Hodgkin-Huxley model nor the neuron in Fig.1.6 has these currents, 
and even if they did, the hyperpolarization is too short and too weak to affect the 
currents. 

Another interesting phenomenon is depicted in Fig.1.7. The neuron is stimulated 
with brief pulses of current mimicking an incoming burst of three spikes. When the 
stimulation frequency is high (5 ms period), presumably reflecting a strong input, 
the neuron does not fire at all. However, stimulation with a lower frequency (10 
ms period) that resonates with the frequency of subthreshold oscillation of the neuron 
evokes a spike response, regardless of whether the stimulation is excitatory or inhibitory. 
Stimulation with even lower frequency (15 ms period) cannot elicit spike response again. 
Thus, the neuron is sensitive only to the inputs having resonant frequency. The same 
pulses applied to a cortical pyramidal neuron evoke a response only in the first case 
(small period), but not in the other cases. 
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1.1.3. Why Are Neurons Different, and Why Do We Care? 


Why would two neurons respond completely differently to the same input? A biologist 
would say that the response of a neuron depends on many factors, such as the type 
of voltage- and Ca?t-gated channels expressed by the neuron, the morphology of its 
dendritic tree, the location of the input, and other factors. These factors are indeed 
important, but they do not determine the neuronal response per se. Rather they 
determine the rules that govern dynamics of the neuron. Different conductances and 
currents can result in the same rules, and hence in the same responses; conversely, 
similar currents can result in different rules and in different responses. The currents 
define what kind of dynamical system the neuron is. 

We study ionic transmembrane currents in chapter 2. In subsequent chapters we 
investigate how the types of currents determine neuronal dynamics. We divide all cur- 
rents into two major classes: amplifying and resonant, with the persistent Nat current 
Ixap and the persistent K* current Ix being the typical examples of the former and 
the latter, respectively. Since there are tens of known currents, purely combinatorial 
argument implies that there are millions of different electrophysiological mechanisms 
of spike generation. We will show later that any such mechanism must have at least 
one amplifying and one resonant current. Some mechanisms, called minimal in this 
book, have one resonant and one amplifying current. They provide an invaluable tool 
in classifying and understanding the electrophysiology of spike generation. 

Many illustrations in this book are based on simulations of the reduced Ina,p + Ik- 
model (pronounced persistent sodium plus potassium model), which consists of a fast 
persistent Na* (amplifying) current and a slower persistent K* (resonant) current. It 
is equivalent to the famous and widely used Morris-Lecar [¢,+/«%-model (Morris and 
Lecar 1981). We show that the model exhibits quite different dynamics, depending on 
the values of the parameters, e.g., the half-activation voltage of the Kt current: in one 
case, it can fire in a narrow frequency range, it can exhibit coexistence of resting and 
spiking states, and it has damped subthreshold oscillations of membrane potential. In 
another case, it can fire in a wide frequency range and show no coexistence of resting 
and spiking and no subthreshold oscillations. Thus, seemingly inessential differences 
in parameter values could result in drastically distinct behaviors. 


1.1.4 Building Models 


To build a good model of a neuron, electrophysiologists apply different pharmacologi- 
cal blockers to tease out the currents that the neuron has. Then they apply different 
stimulation protocols to measure the kinetic parameters of the currents, such as the 
Boltzmann activation function, time constants, and maximal conductances. We con- 
sider all these functions in chapter 2. Next, they create a Hodgkin-Huxley-type model 
and simulate it using the NEURON, GENESIS, or XPP environment or MATLAB (the 
first two are invaluable tools for simulating realistic dendritic structures). 

The problem is that the parameters are measured in different neurons and then put 
together into a single model. As an illustration, consider two neurons having the same 
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Figure 1.8: Neurons are dynamical systems. 


currents, say JNa,» and J, and exhibiting excitable behavior; that is, both neurons are 
quiescent but can fire a spike in response to a stimulation. Suppose the second neuron 
has stronger INa,p, which is balanced by stronger Ix. If we measure Na* conductance 
using the first neuron and K* conductance using the second neuron, the resulting 
INa,p + [x-model will have an excess of K* current and probably will not be able to fire 
spikes at all. Conversely, if we measure Na? and K* conductances using the second 
neuron and then the first neuron, respectively, the model would have too much Na* 
current and probably would exhibit sustained pacemaking activity. In any case, the 
model fails to reproduce the excitable behavior of the neurons whose parameters we 
measured. 


Some of the parameters cannot be measured at all, so many arbitrary choices are 
made via a process called “fine-tuning”. Navigating in the dark, possibly with the help 
of some biological intuition, the researcher modifies parameters, compares simulations 
with experiment, and repeats this trial-and-error procedure until he or she is satisfied 
with the results. Since seemingly similar values of parameters can result in drastically 
different behaviors, and quite different parameters can result in seemingly similar be- 
haviors, how do we know that the resulting model is correct? How do we know that its 
behavior is equivalent to that of the neuron we want to study? And what is equivalent 
in this case? Now, you are primed to consider dynamical systems. If not, see Fig.1.8. 
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1.2 Dynamical Systems 


In chapter 2 we introduce the Hodgkin-Huxley formalism to describe neuronal dynamics 
in terms of activation and inactivation of voltage-gated conductances. An important 
result of the Hodgkin-Huxley studies is that neurons are dynamical systems, so they 
should be studied as such. Below we mention some of the important concepts of 
dynamical systems theory. The reader does not have to follow all the details of this 
section because the concepts are explained in greater detail in subsequent chapters. 

A dynamical system consists of a set of variables that describe its state and a 
law that describes the evolution of the state variables with time (i.e., how the state 
of the system in the next moment of time depends on the input and its state in the 
previous moment of time). The Hodgkin-Huxley model is a four-dimensional dynamical 
system because its state is uniquely determined by the membrane potential, V, and so- 
called gating variables n,m, and h for persistent K* and transient Na* currents. The 
evolution law is given by a four-dimensional system of ordinary differential equations. 

Typically, all variables describing neuronal dynamics can be classified into four 
classes, according to their function and the time scale. 


1. Membrane potential. 


2. Excitation variables, such as activation of a Na* current. These variables are 
responsible for the upstroke of the spike. 


3. Recovery variables, such as inactivation of a Na* current and activation of a fast 
K* current. These variables are responsible for the repolarization (downstroke) 
of the spike. 


4. Adaptation variables, such as activation of slow voltage- or Ca?*+-dependent cur- 
rents. These variables build up during prolonged spiking and can affect excitabil- 
ity in the long run. 


The Hodgkin-Huxley model does not have variables of the fourth type, but many 
neuronal models do, especially those exhibiting bursting dynamics. 


1.2.1 Phase Portraits 


The power of the dynamical systems approach to neuroscience, as well as to many 
other sciences, is that we can tell something, or many things, about a system without 
knowing all the details that govern the system evolution. We do not even use equations 
to do that! Some may even wonder why we call it a mathematical theory. 

As a start, let us consider a quiescent neuron whose membrane potential is rest- 
ing. From the dynamical systems point of view, there are no changes of the state 
variables of such a neuron; hence it is at an equilibrium point. All the inward currents 
that depolarize the neuron are balanced, or equilibrated, by the outward currents that 
hyperpolarize it. If the neuron remains quiescent despite small disturbances and mem- 
brane noise, as in Fig.1.9a (top), then we conclude that the equilibrium is stable. Isn’t 
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Figure 1.9: Resting, excitable, and periodic spiking activity correspond to a stable 
equilibrium (a and b) or limit cycle (c), respectively. 


it amazing that we can reach such a conclusion without knowing the equations that 
describe the neuron’s dynamics? We do not even know the number of variables needed 
to describe the neuron; it could be infinite, for all we care. 

In this book we introduce the notions of equilibria, stability, threshold, and attrac- 
tion domains using one- and two-dimensional dynamical systems, e.g., the [Na py+lk- 
model with instantaneous Na* kinetics. The state of this model is described by the 
membrane potential, V, and the activation variable, n, of the persistent K* current, so 
it is a two-dimensional vector (V,n). Instantaneous activation of the Nat current is a 
function of V, so it does not result in a separate variable of the model. The evolution 
of the model is a trajectory (V(t), n(t)) on the V x n—plane. Depending on the initial 
point, the system can have many trajectories, such as those depicted in Fig.1.9a (bot- 
tom). Time is not explicitly present in the figure, but units of time may be thought 
of as plotted along each trajectory. All of the trajectories in the figure are attracted 
to the stable equilibrium denoted by the black dot, called an attractor. The overall 
qualitative description of dynamics can be obtained through the study of the phase 
portrait of the system, which depicts certain special trajectories (equilibria, separatri- 
ces, limit cycles) that determine the topological behavior of all the other trajectories in 
the phase space. Probably 50 percent of illustrations in this book are phase portraits. 

A fundamental property of neurons is excitability, illustrated in Fig.1.9b. The neu- 
ron is resting, i.e., its phase portrait has a stable equilibrium. Small perturbations, 
such as A, result in small excursions from the equilibrium, denoted as PSP (postsynap- 
tic potential). Larger perturbations, such as B, are amplified by the neuron’s intrinsic 
dynamics and result in the spike response. To understand the dynamic mechanism of 
such amplification, we need to consider the geometry of the phase portrait near the 
resting equilibrium, i.e., in the region where the decision to fire or not to fire is made. 
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Figure 1.10: Rhythmic transitions between resting and spiking modes result in bursting 
behavior. 
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Figure 1.11: As the magnitude of the injected current slowly increases, the neurons 
bifurcate from resting (equilibrium) mode to tonic spiking (limit cycle) mode. 


If we inject a sufficiently strong current into the neuron, we bring it to a pacemaking 
mode, so that it exhibits periodic spiking activity, as in Fig.1.9c. From the dynamical 
systems point of view, the state of such a neuron has a stable limit cycle, also known as 
a stable periodic orbit. The electrophysiological details of the neuron (i.e., the number 
and the type of currents it has, their kinetics, etc.) determine only the location, the 
shape, and the period of the limit cycle. As long as the limit cycle exists, the neuron 
can have periodic spiking activity. Of course, equilibria and limit cycles can coexist, 
so a neuron can be switched from one mode to another by a transient input. The 
famous example is the permanent extinguishing of ongoing spiking activity in the squid 
giant axon by a brief transient depolarizing pulse of current applied at a proper phase 
(Guttman et al. 1980) — a phenomenon predicted by John Rinzel (1978) purely on 
the basis of theoretical analysis of the Hodgkin-Huxley model. The transition between 
resting and spiking modes could be triggered by intrinsic slow conductances, resulting 
in the bursting behavior in Fig.1.10. 
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1.2.2 Bifurcations 


Now suppose that the magnitude of the injected current is a parameter that we can 
control, e.g., we can ramp it up, as in Fig.1.11. Each cell in the figure is quiescent 
at the beginning of the ramps, so its phase portrait has a stable equilibrium and it 
may look like the one in Fig.1.9a or Fig.1.9b. Then it starts to fire tonic spikes, so 
its phase portrait has a limit cycle attractor and it may look like the one in Fig.1.9c, 
with a white circle denoting an unstable resting equilibrium. Apparently there is some 
intermediate level of injected current that corresponds to the transition from resting 
to sustained spiking, i.e., from the phase portrait in Fig.1.9b to Fig.1.9c. What does 
the transition look like? 

From the dynamical systems point of view, the transition corresponds to a bifurca- 
tion of neuron dynamics, i.e., a qualitative change of phase portrait of the system. For 
example, there is no bifurcation going from the phase portrait in Fig.1.9a to that in 
Fig.1.9b, since both have one globally stable equilibrium; the difference in behavior is 
quantitative but not qualitative. In contrast, there is a bifurcation going from Fig.1.9b 
to Fig.1.9c, since the equilibrium is no longer stable and another attractor, limit cycle, 
has appeared. The neuron is not excitable in Fig.1.9a but it is in Fig.1.9b, simply 
because the former phase portrait is far from the bifurcation and the latter is near. 

In general, neurons are excitable because they are near bifurcations from resting 
to spiking activity, so the type of the bifurcation determines the excitable properties 
of the neuron. Of course, the type depends on the neuron’s electrophysiology. An 
amazing observation is that there could be millions of different electrophysiological 
mechanisms of excitability and spiking, but there are only four — yes, four — different 
types of bifurcations of equilibrium that a system can undergo without any additional 
constraints, such as symmetry. Thus, considering these four bifurcations in a general 
setup, we can understand excitable properties of many models, even those that have not 
been invented yet. What is even more amazing, we can understand excitable properties 
of neurons whose currents are not measured and whose models are not known, provided 
we can experimentally identify which of the four bifurcations the resting state of the 
neuron undergoes. 

The four bifurcations are summarized in Fig.1.12, which plots the phase portrait 
before (left), at (center), and after (right) a particular bifurcation occurs. Mathemati- 
cians refer to these bifurcations as being of codimension-1 because we need to vary only 
one parameter, e.g., the magnitude of the injected DC current J, to observe the bifur- 
cations reliably in simulations or experiments. There are many more codimension-2, 3, 
(etc.), bifurcations, but they need special conditions to be observed. We discuss these 
in chapter 6. 

Let us consider the four bifurcations and their phase portraits in Fig.1.12. The 
horizontal and vertical axes are the membrane potential with instantaneous activation 
variable and a recovery variable, respectively. At this stage, the reader is not required 
to fully understand the intricacies of the phase portraits in the figure, since they will 
be explained systematically in later chapters. 
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Figure 1.12: Four generic (codimension-1) bifurcations of an equilibrium state leading 
to the transition from resting to periodic spiking behavior in neurons. 
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e Saddle-node bifurcation. As the magnitude of the injected current or any other 
bifurcation parameter changes, a stable equilibrium corresponding to the resting 
state (black circle marked “node” in Fig.1.12a) is approached by an unstable 
equilibrium (white circle marked “saddle” ); they coalesce and annihilate each 
other, as in Fig.1.12a (middle). Since the resting state no longer exists, the tra- 
jectory describing the evolution of the system jumps to the limit cycle attractor, 
indicating that the neuron starts to fire tonic spikes. Notice that the limit cy- 
cle, or some other attractor, must coexist with the resting state in order for the 
transition resting — spiking to occur. 


e Saddle-node on invariant circle bifurcation is similar to the saddle-node bifurca- 
tion except that there is an invariant circle at the moment of bifurcation, which 
then becomes a limit cycle attractor, as in Fig.1.12b. 


e Subcritical Andronov-Hopf bifurcation. A small unstable limit cycle shrinks to 
a stable equilibrium and makes it lose stability, as in Fig.1.12c. Because of 
instabilities, the trajectory diverges from the equilibrium and approaches a large- 
amplitude spiking limit cycle or some other attractor. 


e Supercritical Andronov-Hopf bifurcation. The stable equilibrium loses stability 
and gives birth to a small-amplitude limit cycle attractor, as in Fig.1.12d. As 
the magnitude of the injected current increases, the amplitude of the limit cycle 
increases and it becomes a full-size spiking limit cycle. 


Notice that there is a coexistence of resting and spiking states in the case of saddle- 
node and subcritical Andronov-Hopf bifurcations, but not in the other two cases. Such 
a coexistence reveals itself via a hysteresis behavior when the injected current slowly 
increases and then decreases past the bifurcation value, because the transitions “resting 
— spiking” and “spiking — resting” occur at different values of the current. In addition, 
brief stimuli applied at the appropriate times can switch the activity from spiking to 
resting and back. There are also spontaneous noise-induced transitions between the 
two modes that result in the stuttering spiking that, for instance, is exhibited by 
the so-called fast spiking (FS) cortical interneurons when they are kept close to the 
bifurcation (Tateno et al. 2004). Some bistable neurons have a slow adaptation current 
that activates during the spiking mode and impedes spiking, often resulting in bursting 
activity. 

Systems undergoing Andronov-Hopf bifurcations, whether subcritical or supercrit- 
ical, exhibit damped oscillations of membrane potential, whereas systems near saddle- 
node bifurcations, whether on or off an invariant circle, do not. The existence of 
small amplitude oscillations creates the possibility of resonance to the frequency of the 
incoming pulses, as in Fig.1.7, and other interesting features. 

We refer to neurons with damped subthreshold oscillations as resonators and to 
those that do not have this property as integrators. We refer to the neurons that ex- 
hibit the coexistence of resting and spiking states, at least near the transition from 
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Figure 1.14: Frequency-current (F-I) curves of cortical pyramidal neuron and brainstem 
mesV neuron from Fig.7.3. These are the same neurons used in the ramp experiment 
in Fig.1.11. 


resting to spiking, as bzstable, and to those that do not, monostable. The four bifur- 
cations in Fig.1.12 are uniquely defined by these two features. For example, a bistable 
resonator is a neuron undergoing subcritical Andronov-Hopf bifurcation, and a monos- 
table integrator is a neuron undergoing saddle-node on invariant circle bifurcation (see 
Fig.1.13). Cortical fast spiking (FS) and regular spiking (RS) neurons, studied in 
chapter 8, are typical examples of the former and the latter, respectively. 


1.2.3. Hodgkin Classification 


Hodgkin (1948) was the first to study bifurcations in neuronal dynamics, years before 
the mathematical theory of bifurcations was developed. He stimulated squid axons 
with pulses of various amplitudes and identified three classes of responses: 


e Class 1 neural excitability. Action potentials can be generated with arbitrarily 
low frequency, depending on the strength of the applied current. 


e Class 2 neural excitability. Action potentials are generated in a certain frequency 
band that is relatively insensitive to changes in the strength of the applied current. 


Introduction 15 


e Class 3 neural excitability. A single action potential is generated in response to a 
pulse of current. Repetitive (tonic) spiking can be generated only for extremely 
strong injected currents or not at all. 


The qualitative distinction between the classes is that the frequency-current relation 
(the F-I curve in Fig.1.14) starts from zero and continuously increases for Class 1 
neurons, is discontinuous for Class 2 neurons, and is not defined at all for Class 3 
neurons. 

Obviously, neurons belonging to different classes have different neurocomputational 
properties. Class 1 neurons, which include cortical excitatory pyramidal neurons, 
can smoothly encode the strength of the input into the output firing frequency, as 
in Fig.1.11 (left). In contrast, Class 2 neurons, such as fast-spiking (FS) cortical in- 
hibitory interneurons, cannot do that; instead, they fire in a relatively narrow frequency 
band, as in Fig.1.11 (right). Class 3 neurons cannot exhibit sustained spiking activ- 
ity, so Hodgkin regarded them as “sick” or “unhealthy”. There are other distinctions 
between the classes, which we discuss later. 

Different classes of excitability occur because neurons have different bifurcations 
of resting and spiking states — a phenomenon first explained by Rinzel and Ermen- 
trout (1989). If ramps of current are injected to measure the F-I curves, then Class 
1 excitability occurs when the neuron undergoes the saddle-node bifurcation on an 
invariant circle depicted in Fig.1.12b. Indeed, the period of the limit cycle attractor 
is infinite at the bifurcation point, and then it decreases as the bifurcation parameter 
— say, the magnitude of the injected current — increases. The other three bifurcations 
result in Class 2 excitability. Indeed, the limit cycle attractor exists and has a finite 
period when the resting state in Fig.1.12 undergoes a subcritical Andronov-Hopf bi- 
furcation, so emerging spiking has a nonzero frequency. The period of the small limit 
cycle attractor appearing via supercritical Andronov-Hopf bifurcation is also finite, so 
the frequency of oscillations is nonzero, but their amplitudes are small. In contrast 
to the common and erroneous folklore, the saddle-node bifurcation (off-limit cycle) 
also results in Class 2 excitability because the limit cycle has a finite period at the 
bifurcation. There is a considerable latency (delay) to the first spike in this case, 
but the subsequent spiking has nonzero frequency. Thus, the simple scheme “Class 1 
= saddle-node, Class 2 = Hopf” that permeates many publications is unfortunately 
incorrect. 

When pulses of current are used to measure the F-I curve, as in Hodgkin’s exper- 
iments, the firing frequency depends on factors besides the type of the bifurcation of 
the resting state. In particular, low-frequency firing can be observed in systems near 
Andronov-Hopf bifurcations, as we show in chapter 7. To avoid possible confusion, we 
define the class of excitability only on the basis of slow ramp experiments. 

Hodgkin’s classification has an important historical value, but it is of little use for 
the dynamic description of a neuron, since naming a class of excitability of a neuron 
does not tell much about the bifurcations of the resting state. Indeed, it says only 
that saddle-node on invariant circle bifurcation (Class 1) is different from the other 
three bifurcations (Class 2), and only when ramps are injected. Dividing neurons into 
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integrators and resonators with bistable or monostable activity is more informative, 
so we adopt the classification in Fig.1.13 in this book. In this classification, a Class 1 
neuron is a monostable integrator, whereas a Class 2 neuron can be a bistable integrator 
or a resonator. 


1.2.4 Neurocomputational properties 


Using the same arrangement as in Fig.1.13, we depict typical geometry of phase 
portraits near the four bifurcations in Fig.1.15. Let us use the portraits to explain 
what happens “near the threshold”, i.e., near the place where the decision to fire or 
not to fire is made. To simplify our geometrical analysis, we assume here that neurons 
receive shock inputs, i.e., brief but strong pulses of current that do not change the 
phase portraits, but only push or reset the state of the neuron into various regions of 
the phase space. We consider these and other cases in detail in chapter 7. 

The horizontal axis in each plot in Fig.1.15 corresponds to the membrane potential 
V with instantaneous Nat current, and the vertical axis corresponds to a recovery vari- 
able, say activation of Kt current. Black circles denote stable equilibria corresponding 
to the neuronal resting state. Spiking limit cycle attractors correspond to sustained 
spiking states, which exist in the two cases depicted in the left half of the figure corre- 
sponding to the bistable dynamics. The limit cycles are surrounded by shaded regions 
— their attraction domains. The white region is the attraction domain of the equilib- 
rium. To initiate spiking, the external input should push the state of the system into 
the shaded region, and to extinguish spiking, the input should push the state back into 
the white region. 

There are no limit cycles in the two cases depicted in the right half of the figure, 
so the entire phase space is the attraction domain of the stable equilibrium, and the 
dynamics are monostable. However, if the trajectory starts in the shaded region, it 
makes a large-amplitude rotation before returning to the equilibrium — a transient 
spike. Apparently, to elicit such a spike, the input should push the state of the system 
into the shaded region. 

Now let us contrast the upper and lower halves of the figure, corresponding to 
integrators and resonators, respectively. We distinguish these two modes of operation 
on the basis of the existence of subthreshold oscillations near the equilibrium. 

First, let us show that inhibition impedes spiking in integrators, but can promote it 
in resonators. In the integrator, the shaded region is in the depolarized voltage range, 
i.e., to the right of the equilibrium. Excitatory inputs push the state of the system 
toward the shaded region, while inhibitory inputs push it away. In resonators, both 
excitation and inhibition push the state toward the shaded region, because the region 
wraps around the equilibrium and can be reached along any direction. This explains 
the rebound spiking phenomenon depicted in Fig.1.6. 

Integrators have all-or-none spikes; resonators may not. Indeed, any trajectory 
starting in the shaded region in the upper half of Fig.1.15 has to rotate around the 
white circle at the top that corresponds to an unstable equilibrium. Moreover, the 
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Figure 1.15: The geometry of phase portraits of excitable systems near four bifurcations 
can explain many neurocomputational properties (see section 1.2.4 for details). 


state of the system is quickly attracted to the spiking trajectory and moves along that 
trajectory, thereby generating a stereotypical spike. A resonator neuron also can fire 
large amplitude spikes when its state is pushed to or beyond the trajectory denoted 
“spike”. Such neurons generate subthreshold responses when the state slides along 
the smaller trajectory denoted PSP; they also can generate spikes of an intermediate 
amplitude when the state is pushed between the PSP and “spike” trajectories, which 
explains the partial-amplitude spiking in Fig.1.5b or in the squid axon in Fig.7.26. The 
set of initial conditions corresponding to such spiking is quite small, so typical spikes 
have large amplitudes and partial spikes are rare. 

Integrators have well-defined thresholds; resonators may not. The white circles near 
the resting states of integrators in Fig.1.15 are called saddles. They are stable along the 
vertical direction and unstable along the horizontal direction. The two trajectories 
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that lead to the saddle along the vertical direction are called separatrices because 
they separate the phase space into two regions — in this case, white and shaded. The 
separatrices play the role of thresholds since only those perturbations that push the 
state of the system beyond them result in a spike. The closer the state of the system 
is to the separatrices, the longer it takes to converge and then diverge from the saddle, 
resulting in a long latency to the spike. Notice that the threshold is not a point, but 
a tilted curve that spans a range of voltage values. 


Resonators have a well-defined threshold in the case of subcritical Andronov-Hopf 
bifurcation: it is the small unstable limit cycle that separates the attraction domains 
of stable equilibrium and spiking limit cycle. Trajectories inside the small cycle spi- 
ral toward the stable equilibrium, whereas trajectories outside the cycle spiral away 
from it and eventually lead to sustained spiking activity. When a neuronal model is 
far from the subcritical Andronov-Hopf bifurcation, its phase portrait may look sim- 
ilar to the one corresponding to the supercritical Andronov-Hopf bifurcation. The 
narrow shaded band in the figure is not a threshold manifold but a fuzzy thresh- 
old set called “quasi-threshold” by FitzHugh (1955). Many resonators, including the 
Hodgkin-Huxley model, have quasi-thresholds instead of thresholds. The width of the 
quasi-threshold in the Hodgkin-Huxley model is so narrow that for all practical reasons 
it may be assumed to be just a curve. 


Integrators integrate, resonators resonate. Now consider inputs consisting of multi- 
ple pulses, e.g., a burst of spikes. Integrators prefer high-frequency inputs; the higher 
the frequency, the sooner they fire. Indeed, the first spike of such an input, marked 
“1” in the top-right phase portrait in Fig.1.15, increases the membrane potential and 
shifts the state to the right, toward the threshold. Since the state of the system is 
still in the white area, it slowly converges back to the stable equilibrium. To cross 
the threshold manifold, the second pulse must arrive shortly after the first one. The 
reaction of a resonator to a pair of pulses is quite different. The first pulse initiates a 
damped subthreshold oscillation of the membrane potential, which looks like a spiral 
in the bottom-right phase portrait in Fig.1.15. The effect of the second pulse depends 
on its timing. If it arrives after the trajectory makes half a rotation, marked “2” in the 
figure, it cancels the effect of the first pulse. If it arrives after the trajectory makes a 
full rotation, marked “3” in the figure, it adds to the first pulse and either increases the 
amplitude of subthreshold oscillation or evokes a spike response. Thus, the response 
of the resonator neuron depends on the frequency content of the input, as in Fig.1.7. 


Integrators and resonators constitute two major modes of activity of neurons. Most 
cortical pyramidal neurons, including the regular spiking (RS), intrinsically bursting 
(IB), and chattering (CH) types considered in Chap. 8, are integrators. So are thalam- 
ocortical neurons in the relay mode of firing, and neostriatal spiny projection neurons. 
Most cortical inhibitory interneurons, including the FS type, are resonators. So are 
brainstem mesencephalic V neurons and stellate neurons of the entorhinal cortex. Some 
cortical pyramidal neurons and low-threshold spiking (LTS) interneurons can be at the 
border of transition between integrator and resonator modes. Such a transition corre- 
sponds to another bifurcation, which has codimension-2, and hence it is less likely to 
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Figure 1.16: Phase portrait of a system near a 
Bogdanoy-Takens bifurcation that corresponds to 
the transition from integrator to resonator mode. 


be encountered experimentally. We consider this and other uncommon bifurcations in 
detail later. The phase portrait near the bifurcation is depicted in Fig.1.16, and it is a 
good exercise for the reader to explain why such a system has damped oscillations and 
postinhibitory responses, yet a well-defined threshold, all-or-none spikes, and possibly 
long latencies. 

Of course, figures 1.15 and 1.16 cannot encompass all the richness of neuronal behav- 
ior, otherwise this book would be only 19pages long (this book is actually quite short; 
most of the space is taken by figures, exercises, and solutions). Many aspects of neu- 
ronal dynamics depend on other bifurcations, e.g., those corresponding to appearance 
and disappearance of spiking limit cycles. These bifurcations describe the transitions 
from spiking to resting, and they are especially important when we consider bursting 
activity. In addition, we need to take into account the relative geometry of equilibria, 
limit cycles, and other relevant trajectories, and how they depend on the parameters of 
the system, such as maximal conductances, and activation time constants. We explore 
all these issues systematically in subsequent chapters. 


In chapter 2 we review some of the most fundamental concepts of neuron elec- 
trophysiology, culminating with the Hodgkin-Huxley model. This chapter is aimed 
at mathematicians learning neuroscience. In chapters 3 and 4 we use one- and two- 
dimensional neuronal models, respectively, to review some of the most fundamental 
concepts of dynamical systems, such as equilibria, limit cycles, stability, attraction 
domain, nullclines, phase portrait, and bifurcation. The material in these chapters, 
aimed at biologists learning the language of dynamical systems, is presented with the 
emphasis on geometrical rather than mathematical intuition. In fact, the spirit of 
the entire book is to explain concepts by using pictures, not equations. Chapter 5 
explores phase portraits of various conductance-based models and the relations be- 
tween ionic currents and dynamic behavior. In Chapter 6 we use the [Na,»+J«K-model 
to systematically introduce the geometric bifurcation theory. Chapter 7, probably the 
most important chapter of the book, applies the theory to explain many computational 
properties of neurons. In fact, all the material in the previous chapters is given so that 
the reader can understand this chapter. In chapter 8 we use a simple phenomenological 
model to simulate many cortical, hippocampal, and thalamic neurons. This chapter 
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contains probably the most comprehensive up-to-date review of various firing patterns 
exhibited by mammalian neurons. In chapter 9 we introduce the electrophysiological 
and topological classification of bursting dynamics, as well as some useful methods to 
study the bursters. Finally, the last and the most mathematically advanced chapter 
of the book, Chap. 10, deals with coupled neurons. There we show how the details of 
the spike generation mechanism of neurons affect neurons’ collective properties, such 
as synchronization. 


1.2.5 Building Models (Revisited) 


To have a good model of a neuron, it is not enough to put the right kind of currents 
together and tune the parameters so that the model can fire spikes. It is not even 
enough to reproduce the right input resistance, rheobase, and firing frequencies. The 
model has to reproduce all the neurocomputational features of the neuron, starting with 
the coexistence of resting and spiking states, spike latencies, subthreshold oscillations, 
and rebound spikes, among others. 

A good way to start is to determine what kind of bifurcations the neuron under 
consideration undergoes and how the bifurcations depend on neuromodulators and 
pharmacological blockers. Instead of or in addition to measuring neuronal responses 
to get the kinetic parameters, we need to measure them to get the right bifurcation 
behavior. Only in this case we can be sure that the behavior of the model is equivalent 
to that of the neuron, even if we omitted a current or guessed some of the parameters 
incorrectly. 

Implementation of this research program is still a pipe dream. The people who 
understand the mathematical aspects of neuron dynamics — those who see beyond 
conductances and currents — usually do not have the opportunity to do experiments. 
Conversely, those who study neurons in vitro or in vivo on a daily basis — those who see 
spiking, bursting, and oscillations; those who can manipulate the experimental setup 
to test practically any aspect of neuronal activity — do not usually see the value of 
studying phase portraits, bifurcations, and nonlinear dynamics in general. One of the 
goals of this book is to change this state and bring these two groups of people closer 
together. 
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Review of Important Concepts 


Neurons are dynamical systems. 


The resting state of neurons corresponds to a stable equilibrium; the 
tonic spiking state corresponds to a limit cycle attractor. 


Neurons are excitable because the equilibrium is near a bifurcation. 


There are many ionic mechanisms of spike generation, but only four 
generic bifurcations of equilibria. 


These bifurcations divide neurons into four categories: integrators 
or resonators, monostable or bistable. 


Analyses of phase portraits at bifurcations explain why some neu- 
rons have well-defined thresholds, all-or-none spikes, postinhibitory 
spikes, frequency preference, hysteresis, and so on, while others do 
not. 


These features, and not ionic currents per se, determine the neuronal 
responses, i.e., the kind of computations neurons do. 


A good neuronal model must reproduce not only electrophysiology 
but also the bifurcation dynamics of neurons. 


Bibliographical Notes 


Richard FitzHugh at the National Institutes of Health (NIH) pioneered the phase plane 
analysis of neuronal models with the view to understanding their neurocomputational 
properties. He was the first to analyze the Hodgkin-Huxley model (FitzHugh 1955; 
years before they received the Nobel Prize) and to prove that it has neither threshold 
nor all-or-none spikes. FitzHugh (1961) introduced the simplified model of excitability 
(see Fig.1.18) and showed that one can get the right kind of neuronal dynamics in mod- 
els lacking conductances and currents. Nagumo et al. (1962) designed a corresponding 
tunnel diode circuit, so the model is called the FitzHugh-Nagumo oscillator. Chapter 8 
deals with such simplified models. The history of the development of Fitz Hugh-Nagumo 
model is reviewed by Izhikevich and FitzHugh (2006). 

FitzHugh’s research program was further developed by John Rinzel and G. Bard 
Ermentrout (see Fig.1.19 and Fig.1.20). In their 1989 seminal paper, Rinzel and Er- 
mentrout revived Hodgkin’s classification of excitability and pointed out the connection 
between the behavior of neuronal models and the bifurcations they exhibit. (They also 
referred to the excitability as “type I’ or “type II”). Unfortunately, many people treat 
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Figure 1.17: Richard FitzHugh in 1984. 
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Figure 1.18: Phase portrait and physiological state diagram of FitzHugh-Nagumo 
model V = V —V3/3-W +41, W = 0.08(V + 0.7 — 0.8W). The meaning of curves 


and trajectories is explained in chapter 4. (Reproduced from Izhikevich and FitzHugh 
(2006) with permission. ) 
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Figure 1.19: John Rinzel in 2004. Depicted on his T-shirt is the cover of the first issue 
of Journal of Computational Neuroscience, in which the Pinsky-Rinzel (1994) model 
appeared. 


Figure 1.20: G. Bard Ermentrout (G. stands for George) with his parrot, Junior, in 
1983. 
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the connection in a simpleminded fashion and incorrectly identify “type I = saddle- 
node, type II = Hopf”. If only life were so simple! 

The geometrical analysis of neuronal models was further developed by, among oth- 
ers, Izhikevich (2000a), who stressed the integrator and resonator modes of operation 
and made connections to other neurocomputational properties. 

The neuroscience and mathematics parts of this book are standard, though many 
connections are new. The literature sources are listed at the end of each chapter. 
Among many outstanding books on computational neuroscience, the author especially 
recommends Spikes, Decisions, and Actions by Wilson (1999), Biophysics of Com- 
putation by Koch (1999), Theoretical Neuroscience by Dayan and Abbott (2001), and 
Foundations of Cellular Neurophysiology by Johnston and Wu (1995). The present vol- 
ume complements these excellent books in the sense that it is more ambitious, focused, 
and thorough in dealing with neurons as dynamical systems. Though its views may 
be biased by the author’s philosophy and taste, the payoffs in understanding neuronal 
dynamics are immense, provided the reader has enough patience and perseverance to 
follow the author’s line of thought. 

The NEURON simulation environment is described by Hines (1989) and Carnevale 
and Hines (2006) (http://www.neuron.yale.edu); the GENESIS environment, by 
Bower and Beeman (1995) (http://www. genesis-sim.org); the XPP environment, 
by Ermentrout (2002). The author of this book uses MATLAB, which has become a 
standard computational tool in science and engineering. MATLAB is the registered 
trademark of The MathWorks, Inc. (http://www.mathworks.com). 


Chapter 2 


Electrophysiology of Neurons 


In this chapter we remind the reader of some fundamental concepts of neuronal electro- 
physiology that are necessary to understand the rest of the book. We start with ions 
and currents, and move quickly toward the dynamics of the Hodgkin-Huxley model. 
If the reader is already familiar with the Hodgkin-Huxley formalism, this chapter can 
be skipped. Our exposition is brief, and it cannot substitute for a good introductory 
neuroscience course or the reading of such excellent textbooks as Theoretical Neu- 
roscience by Dayan and Abbott (2001), Foundations of Cellular Neurophysiology by 
Johnston and Wu (1995), Biophysics of Computation by Koch (1999), or Jon Channels 
of Excitable Membranes by Hille (2001). 


2.1 Ions 


Electrical activity in neurons is sustained and propagated via ionic currents through 
neuron membranes. Most of these transmembrane currents involve one of four ionic 
species: sodium (Nat), potassium (Kt), calcium (Ca?*), or chloride (Cl~). The first 
three have a positive charge (cations) and the fourth has a negative charge (anion). The 
concentrations of these ions are different on the inside and the outside of a cell, which 
creates electrochemical gradients — the major driving forces of neural activity. The 
extracellular medium has a high concentration of Na* and Cl (salty, like seawater) 
and a relatively high concentration of Ca2+. The intracellular medium has high con- 
centrations of Kt and negatively charged molecules (denoted by A~), as we illustrate 
in Fig.2.1. 

The cell membrane has large protein molecules forming channels through which 
ions (but not A~) can flow according to their electrochemical gradients. The flow of 
Nat and Ca?* ions is not significant, at least at rest, but the flow of Kt and Cl- ions 
is. This, however, does not eliminate the concentration asymmetry for two reasons. 

e Passive redistribution. The impermeable anions A~ attract more K* into the cell 
(opposites attract) and repel more Cl~ out of the cell, thereby creating concen- 
tration gradients. 

e Active transport. Ions are pumped in and out of the cell via ionic pumps. For 
example, the Na*-K* pump depicted in Fig.2.1 pumps out three Nat ions for 
every two K* ions pumped in, thereby maintaining concentration gradients. 
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Figure 2.1: Ion concentrations and Nernst equilibrium potentials (2.1) in a typical 
mammalian neuron (modified from Johnston and Wu 1995). A~ are membrane- 
impermeant anions. Temperature T = 37°C (310°K). 


2.1.1 Nernst Potential 


There are two forces that drive each ion species through the membrane channel: concen- 
tration and electric potential gradients. First, the ions diffuse down the concentration 
gradient. For example, the Kt ions depicted in Fig.2.2a diffuse out of the cell because 
Kt concentration inside is higher than that outside. While exiting the cell, K* ions 
carry a positive charge and leave a net negative charge inside the cell (consisting mostly 
of impermeable anions A~), thereby producing the outward current. The positive and 
negative charges accumulate on the opposite sides of the membrane surface, creating 
an electric potential gradient across the membrane — transmembrane potential or mem- 
brane voltage. This potential slows the diffusion of K*, since Kt ions are attracted 
to the negatively charged interior and repelled from the positively charged exterior of 
the membrane, as we illustrate in Fig.2.2b. At some point an equilibrium is achieved: 
the concentration gradient and the electric potential gradient exert equal and opposite 
forces that counterbalance each other, and the net cross-membrane current is zero, as 
in Fig.2.2c. The value of such an equilibrium potential depends on the ionic species, 
and it is given by the Nernst equation (Hille 2001): 


(2.1) 


where [Ion]};, and [Ion|,u; are concentrations of the ions inside and outside the cell, 
respectively; R is the universal gas constant (8,315 mJ/(K°-Mol)); 7’ is temperature 
in degrees Kelvin (K° = 273.16+C°); F' is Faraday’s constant (96, 480 coulombs/Mol), 
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Figure 2.2: Diffusion of KT ions down the concentration gradient though the membrane 
(a) creates an electric potential force pointing in the opposite direction (b) until the 
diffusion and electrical forces counter each other (c). The resulting transmembrane 
potential (2.1) is referred to as the Nernst equilibrium potential for K*. 


z is the valence of the ion (z = 1 for Nat and Kt; z = —1 for Cl"; and z = 2 for 
Ca?*). Substituting the numbers, taking log;) instead of natural In and using body 
temperature T’ = 310°K (37°C) results in 


[Ion ]out 
[Ion] in 


for monovalent (z = 1) ions. Nernst equilibrium potentials in a typical mammalian 
neuron are summarized in Fig.2.1. 


Eiion © 62 log (mV) 


2.1.2 Ionic Currents and Conductances 


In the rest of the book V denotes the membrane potential and Eya, Eca, Ex, and Eq 
denote the Nernst equilibrium potentials. When the membrane potential equals the 
equilibrium potential, say Ex, the net Kt current, denoted as Ix (A/cm?), is zero 
(this is the definition of the Nernst equilibrium potential for K*). Otherwise, the net 
K* current is proportional to the difference of potentials; that is, 


Ik = 9k (V — Ex), 


where the positive parameter gx (mS/cm?) is the K* conductance and (V — Ex) is the 
K* driving force. The other major ionic currents, 


Ina = 9Na(V — Ena) , Ica = 9ca(V — Eca) , Ia = ga lV — Ea), 
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could also be expressed as products of nonlinear conductances and corresponding driv- 
ing forces. A better description of membrane currents, especially Ca?* current, is 
provided by the Goldman-Hodgkin-Katz equation (Hille 2001), which we do not use in 
this book. 

When the conductance is constant, the current is said to be Ohmic. In general, 
ionic currents in neurons are not Ohmic, since the conductances may depend on time, 
membrane potential, and pharmacological agents, e.g., neurotransmitters, neuromodu- 
lators, second-messengers, etc. It is the time-dependent variation in conductances that 
allows a neuron to generate an action potential, or spike. 


2.1.3. Equivalent Circuit 


It is traditional to represent electrical properties of membranes in terms of equivalent 
circuits similar to the one depicted in Fig.2.3. According to Kirchhoft’s law, the total 
current, J, flowing across a patch of a cell membrane is the sum of the membrane 
capacitive current CV (the capacitance C ~ 1.0 uF /cm? in the squid axon) and all the 
ionic currents 


PCV fig Bie ea, 


where V = dV /dt is the derivative of the voltage variable V with respect to time t. 
The derivative arises because it takes time to charge the membrane. This is the first 
dynamic term in the book! We write this equation in the standard “dynamical system” 
form 


CV =I -Iya—JIea — Ix — Ian (2.2) 
or 
CV =[— GNa (V = Ena) — gCa (V = Eca) — gk (V = Ex) — 9cl (V = Eq) ‘ (2.3) 


If there are no additional current sources or sinks, such as synaptic current, axial 
current, or tangential current along the membrane surface, or current injected via an 
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electrode, then J = 0. In this case, the membrane potential is typically bounded by 
the equilibrium potentials in the order (see Fig.2.4) 


Ex < Ba < Vi ) < Ena < Bea ; 


at rest 
so that Ina, [ca < 0 (inward currents) and Ix, Ic, > 0 (outward currents). From (2.2) 
it follows that inward currents increase the membrane potential, that is, make it more 
positive (depolarization), whereas outward currents decrease it, that is, make it more 
negative (hyperpolarization). Note that J¢ is called an outward current even though 
the flow of Cl” ions is inward; the ions bring negative charge inside the membrane, 
which is equivalent to positively charged ions leaving the cell, as in Ix. 


2.1.4 Resting Potential and Input Resistance 


If there were only Kt channels, as in Fig.2.2, the membrane potential would quickly 
approach the K* equilibrium potential, Ex, which is around —90 mV. Indeed, 


in this case. However, most membranes contain a diversity of channels. For example, 
Na* channels would produce an inward current and pull the membrane potential toward 
the Na* equilibrium potential, Ey,, which could be as large as +90 mV. The value of 
the membrane potential at which all inward and outward currents balance each other so 
that the net membrane current is zero corresponds to the resting membrane potential. 
It can be found from (2.3) with J = 0, by setting V = 0. The resulting expression, 


altna atta E EB 
Vigo Na + 9calca + 9KLK + GaLa (2.4) 


9Na + 9ca + 9K + JCI 


has a nice mechanistic interpretation: Vy. is the center of mass of the balance depicted 
in Fig.2.4. Incidentally, the entire equation (2.3) can be written in the form 


CV =I[- Ginp (VY 3 Veoe) ; (2.5) 


where 
Jinp = JNa + 96x OK G01 


is the total membrane conductance, called input conductance. The quantity Rinp = 
1/ginp is the input resistance of the membrane, and it measures the asymptotic sensi- 
tivity of the membrane potential to injected or intrinsic currents. Indeed, from (2.5) it 
follows that 

Vo Vrest + i Fiais ’ (2.6) 


so greater values of Rin,» imply greater steady-state displacement of V due to the 
injection of DC current I. 

A remarkable property of neuronal membranes is that ionic conductances, and hence 
the input resistance, are functions of V and time. We can use (2.6) to trace an action 
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Figure 2.4: Mechanistic interpretation of the resting membrane potential (2.4) as the 
center of mass. Nat conductance increases during the action potential. 


potential in a quasi-static fashion, i.e., assuming that time is frozen. When a neuron is 
quiescent, Na* and Ca?* conductances are relatively small, Vrest is near Ex and Eq, 
as in Fig.2.4 (top), and so is V. During the upstroke of an action potential, the Nat 
or Ca?* conductance becomes very large; Vyest is near Ey,, as in Fig.2.4 (bottom), and 
V increases, trying to catch Vyes,. This event is, however, quite brief, for the reasons 
explained in subsequent sections. 


2.1.5 Voltage-Clamp and I-V Relation 


In section 2.2 we will study how the membrane potential affects ionic conductances 
and currents, assuming that the potential is fixed at certain value V. controlled by an 
experimenter. To maintain the membrane potential constant (clamped), one inserts 
a metallic conductor to short-circuit currents along the membrane (space-clamp), and 
then injects a current proportional to the difference V. — V (voltage-clamp), as in 
Fig.2.5. From (2.2) and the clamp condition V = 0, it follows that the injected current 
I equals the net current generated by the membrane conductances. 

In a typical voltage-clamp experiment the membrane potential is held at a certain 
resting value V. and then reset to a new value V,, as in Fig.2.6a. The injected membrane 
current needed to stabilize the potential at the new value is a function of time, the 
pre-step holding potential V., and the step potential V,. First, the current jumps to 
a new value to accommodate the instantaneous voltage change from V. to V;. From 
(2.5) we find that the amplitude of the jump is ginp(Vs — Vc). Then, time- and voltage- 
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Figure 2.5: Two-wire voltage-clamp experiment on the axon. The top wire is used to 
monitor the membrane potential V. The bottom wire is used to inject the current J, 
proportional to the difference V.— V, to keep the membrane potential at Ve. 
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Figure 2.6: Voltage-clamp experiment to measure instantaneous and steady-state -V 
relation. Shown are simulations of the Jy,+/x-model (see Fig.4.1b); the continuous 
curves are theoretically found I-V relations. 


dependent processes start to occur and the current decreases and then increases. The 
value at the negative peak, marked by the open circle “o” in Fig.2.6, depends only on V, 
and V,, and it is called the instantaneous current-voltage (I-V) relation, or Ip(Vc, Vs). 
The asymptotic (f — oo) value depends only on V, and it is called the steady-state 
current-voltage (I-V) relation, or I,,(Vs). 

Both relations, depicted in Fig.2.6b, can be found experimentally (black circles) or 
theoretically (curves). The instantaneous I-V relation usually has a non-monotone N- 
shape reflecting nonlinear autocatalytic (positive feedback) transmembrane processes, 
which are fast enough on the time scale of the action potential that they can be assumed 
to have instantaneous kinetics. The steady-state I-V relation measures the asymptotic 
values of all transmembrane processes, and it may be monotone (as in the figure) or 
not, depending on the properties of the membrane currents. Both I-V relations provide 
invaluable quantitative information about the currents operating on fast and slow time 
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Figure 2.7: To tease out neuronal currents, biologists employ an arsenal of sophisticated 
“clamp” methods, such as current-, voltage-, conductance-, and dynamic-clamp. 


scales, and both are useful in building mathematical models of neurons. Finally, when 
I,.(V) = 0, the net membrane current is zero, and the potential is at rest or equilibrium, 
which may still be unstable, as we discuss in the next chapter. 


2.2 Conductances 


Ionic channels are large transmembrane proteins having aqueous pores through which 
ions can flow down their electrochemical gradients. The electrical conductance of indi- 
vidual channels may be controlled by gating particles (gates), which switch the channels 
between open and closed states. The gates may be sensitive to the following factors: 


e Membrane potential. Example: voltage-gated Na* or Kt channels 
e Intracellular agents (second-messengers). Example: Ca?*-gated Kt channels 


e Extracellular agents (neurotransmitters and neuromodulators). Examples: AMPA, 
NMDA, or GABA receptors. 


Despite the stochastic nature of transitions between open and closed states in individual 
channels, the net current generated by a large population or ensemble of identical 
channels can reasonably be described by the equation 


I= gp(V-E), (2.7) 


where p is the average proportion of channels in the open state, g is the maximal 
conductance of the population, and E is the reverse potential of the current, i.e., the 
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Figure 2.8: Structure of voltage-gated ion channels. Voltage sensors open an activation 
gate and allow selected ions to flow through the channel according to their electrochem- 
ical gradients. The inactivation gate blocks the channel. (Modified from Armstrong 
and Hille 1998.) 


potential at which the current reverses its direction. If the channels are selective 
for a single ionic species, then the reverse potential E’ equals the Nernst equilibrium 
potential (2.1) for that ionic species (see exercise 2). 


2.2.1 Voltage-Gated Channels 


When the gating particles are sensitive to the membrane potential, the channels are 
said to be voltage-gated. The gates are divided into two types: those that activate or 
open the channels, and those that inactivate or close them (see Fig.2.8). According to 
the tradition initiated in the middle of the twentieth century by Hodgkin and Huxley, 
the probability of an activation gate being in the open state is denoted by the variable 
m (sometimes the variable n is used for Kt and Cl~ channels). The probability of an 
inactivation gate being in the open state is denoted by the variable h. The proportion 
of open channels in a large population is 


p=m*h’, (2.8) 


where a is the number of activation gates and 6 is the number of inactivation gates 
per channel. The channels can be partially (0 < m < 1) or completely activated 
(m = 1); not activated or deactivated (m = 0); inactivated (h = 0); released from 
inactivation or deinactivated (h = 1). Some channels do not have inactivation gates 
(b = 0), hence p = m*. Such channels do not inactivate, and they result in persistent 
currents. In contrast, channels that do inactivate result in transient currents. 

Below we describe voltage- and time-dependent kinetics of gates. This description 
is often referred to as the Hodgkin-Huzley gate model of membrane channels. 
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Figure 2.9: The activation function m.(V) and the time constant 7(V) of the fast tran- 
sient K* current in layer 5 neocortical pyramidal neurons. (Modified from Korngreen 
and Sakmann 2000.) 


2.2.2 Activation of Persistent Currents 


The dynamics of the activation variable m is described by the first-order differential 
equation 


mM = (Moxo(V)—m)/T(V) , (2.9) 


where the voltage-sensitive steady-state activation function m.(V) and the time con- 
stant T(V) can be measured experimentally. They have sigmoid and unimodal shapes, 
respectively, as in Fig.2.9 (see also Fig.2.20). The steady-state activation function 
Mxo(V) gives the asymptotic value of m when the potential is fixed (voltage-clamp). 
Smaller values of 7(V) result in faster dynamics of m. 


In Fig.2.10 we depict a typical experiment to determine m.(V) of a persistent 
current, i.e., a current having no inactivation variable. Initially we hold the membrane 
potential at a hyperpolarized value Vo so that all activation gates are closed and I & 
0. Then we step-increase V to a greater value V, (s = 1,...,7; see Fig.2.10a) and 
hold it there until the current is essentially equal to its asymptotic value, which is 
denoted here as J, (s stands for “step”; see Fig.2.10b). Repeating the experiment 
for various stepping potentials V,, one can easily determine the corresponding J,, and 
hence the entire steady-state I-V relation, which we depict in Fig.2.10c. According to 
(2.7), 1(V) = gm,.(V)(V — E£), and the steady-state activation curve m..(V) depicted 
in Fig.2.10d is I(V) divided by the driving force (V — E£) and normalized so that 
max M.(V) = 1. To determine the time constant 7(V), one needs to analyze the 
convergence rates. In exercise 6 we describe an efficient method to determine m.(V) 
and 7(V). 
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Figure 2.10: An experiment to determine m,.(V). Shown are simulations of the per- 
sistent Na* current in Purkinje cells (see section 2.3.5). 


2.2.3. Inactivation of Transient Currents 


The dynamics of the inactivation variable h can be described by the first-order differ- 
ential equation 


h = (hoo (V) —h)/T(V) , (2.10) 


where h,,(V) is the voltage-sensitive steady-state inactivation function depicted in 
Fig.2.11. In Fig.2.12 we present a typical voltage-clamp experiment to determine 
hxo(V) in the presence of activation m.(V). It relies on the observation that inacti- 
vation kinetics is usually slower than activation kinetics. First, we hold the membrane 
potential at a certain pre-step potential V, for a long enough time that the activation 
and inactivation variables are essentially equal to their steady-state values m,.(V,) and 
ho(V;), respectively, which have yet to be determined. Then we step-increase V to 
a sufficiently high value Vo, chosen so that m.(Vo) ¥ 1. If activation is much faster 
than inactivation, m approaches 1 after the first few milliseconds, while h continues 
to be near its asymptotic value h, = h.,(V;), which can be found from the peak value 
of the current J, ~ g-1-h,(Vo — FE). Repeating this experiment for various pre-step 
potentials, one can determine the steady-state inactivation curve h.(V) in Fig.2.11. 
In exercise 6 we describe a better method to determine h,,(V) that does not rely on 
the difference between the activation and inactivation time scales. 
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Figure 2.12: Dynamics of the current 
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The voltage-sensitive steady-state activation and inactivation functions overlap in 
a shaded window depicted in Fig.2.11. Depending on the size of the shaded area in the 
figure, the overlap may result in a noticeable “window” current. 


2.2.4 Hyperpolarization-Activated Channels 


Many neurons in various parts of the brain have channels that are opened by hyperpo- 
larization. These channels produce currents that are turned on by hyperpolarization 
and turned off by depolarization. Biologists refer to such currents as “exceptional” or 
“weird”, and denote them as Ig (queer), Js (funny), f, (hyperpolarization-activated), 
or Ixir (+ inward rectifier). (We will consider the last two currents in detail in the 
next chapter). Most neuroscience textbooks classify these currents in a special category 
— hyperpolarization-activated currents. However, from the theoretical point of view, it 
is inconvenient to create special categories. In this book we treat these currents as 
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“normal” transient currents with the understanding that they are always activated 
(either a = 0 or variable m = 1 in (2.8)), but can be inactivated by depolarization 
(variable h — 0) or deinactivated by hyperpolarization (variable h — 1). Moreover, 
there is biophysical evidence suggesting that closing/opening of Ix; is indeed related 
to the inactivation/deinactivation process (Lopatin et al. 1994). 


2.3 The Hodgkin-Huxley Model 


In section 2.1 we studied how the membrane potential depends on the membrane cur- 
rents, assuming that ionic conductances are fixed. In section 2.2 we used the Hodgkin- 
Huxley gate model to study how the conductances and currents depend on the mem- 
brane potential, assuming that the potential is clamped at different values. In this 
section we put it all together and study how the potential < current nonlinear inter- 
actions lead to many interesting phenomena, such as generation of action potentials. 


2.3.1 Hodgkin-Huxley Equations 


One of the most important models in computational neuroscience is the Hodgkin- 
Huxley model of the squid giant axon. Using pioneering experimental techniques of that 
time, Hodgkin and Huxley (1952) determined that the squid axon carries three major 
currents: voltage-gated persistent K* current with four activation gates (resulting in 
the term n* in the equation below, where n is the activation variable for K*); voltage- 
gated transient Nat current with three activation gates and one inactivation gate (the 
term mh below), and Ohmic leak current, J,, which is carried mostly by Cl~ ions. 
The complete set of space-clamped Hodgkin-Huxley equations is 


Ix INa [ 
; aie ane ee 
CV = I — gxn'(V — Ex) — gnam’h(V — Ewa) — gr(V — Ex) 


nm = an(V)(1—n) — B,(V)n 
I = Am(V)(1 = m) = Bmn(V)m 
h = ap(V)(1—h)— Ba(V)h, 


where 
10-—V 


ny, = 401. 
(V) exp(44*) -1 


=V 
(V) = 0.125 ey 
nv) = 012800 (2) 
= VW. 


hy ee, 
om(V) exp(2=") -1 


By(V) = 4exp (=f) | 
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a,(V) = 0.07exp (=) : 
1 
LM). | Saas | 
¢ exp(2=*) +1 


These parameters, provided in the original Hodgkin and Huxley paper, correspond 
to the membrane potential shifted by approximately 65 mV, so that the resting po- 
tential is at V x 0. Hodgkin and Huxley did that for the sake of convenience, but 
the shift has led to a lot of confusion over the years. The shifted Nernst equilibrium 
potentials are 


Ex=-12mV, Eva=1200mV, £,=106mV; 
(see also exercise 1). Typical values of maximal conductances are 
Gx = 36 mS/cm? : Gna = 120 mS/cm? , Gn 02 mS/cm’. 


C = 1pF/cm? is the membrane capacitance and I = 0 A/cm? is the applied current. 
The functions a(V) and 6(V) describe the transition rates between open and closed 
states of the channels. We present this notation only for historical reasons. In the rest 
of the book, we use the standard form 


fh = (Moo(V) — 2)/Tm(V) ; 
(Mo(V) — m)/Tm(V) ; 
= (hoo(V) — h)/ta(V) ; 


ria 
h 


where 
Noo = An/ (An T Bes) ; Tn = 1/(Qn Ie Bn) ; 
Moo = Am/ (Am + Bm) ; Tm = 1/(Qm + Bm) ; 
Roo = An/ (Qn + Br) Th = 1/(an + Ba) 


as depicted in Fig.2.13. These functions can be approximated by the Boltzmann and 
Gaussian functions; see Ex. 4. We also shift the membrane potential back to its true 
value, so that the resting state is near -65 mV. 

The membrane of the squid giant axon carries only two major currents: transient 
Na* and persistent Kt. Most neurons in the central nervous system have additional 
currents with diverse activation and inactivation dynamics, which we summarize in 
section 2.3.5. The Hodgkin-Huxley formalism is the most accepted model to describe 
their kinetics. 

Since we are interested in geometrical and qualitative methods of analysis of neu- 
ronal models, we assume that all variables and parameters have appropriate scales 
and dimensions, but we do not explicitly state them. An exception is the membrane 
potential V, whose mV scale is stated in every figure. 


Electrophysiology of Neurons 39 


0 
-40 0 V (mV) 100 -40 0 V (mV) 100 


Figure 2.13: Steady-state (in)activation functions (left) and voltage-dependent time 
constants (right) in the Hodgkin-Huxley model. 


Figure 2.14: Studies of spike-generation mechanism in “giant squid” axons won Alan 
Hodgkin and Andrew Huxley the 1963 Nobel Prize for physiology or medicine (shared 
with John Eccles). See also Fig. 4.1 in Keener and Sneyd (1998). 
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Figure 2.15: Action potential in the Hodgkin-Huxley model. 
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Figure 2.16: Positive and negative feedback loops resulting in excited (regenerative) 
behavior in neurons. 


2.3.2 Action Potential 


Recall that when V = Vyest, which is 0 mV in the Hodgkin-Huxley model, all inward 
and outward currents balance each other so the net current is zero, as in Fig.2.15. The 
resting state is stable: a small pulse of current applied via /(t) produces a small positive 
perturbation of the membrane potential (depolarization), which results in a small net 
current that drives V back to resting (repolarization). | However, an intermediate 
size pulse of current produces a perturbation that is amplified significantly because 
membrane conductances depend on V. Such a nonlinear amplification causes V to 
deviate considerably from Ves, — a phenomenon referred to as an action potential or 
spike. 

In Fig.2.15 we show a typical time course of an action potential in the Hodgkin- 
Huxley system. Strong depolarization increases activation variables m and n and de- 
creases inactivation variable h. Since 7,,(V) is relatively small, variable m is relatively 
fast. Fast activation of Nat conductance drives V toward Ey,, resulting in further 
depolarization and further activation of gna. This positive feedback loop, depicted in 
Fig.2.16, results in the upstroke of V. While V moves toward Ena, the slower gating 
variables catch up. Variable h — 0, causing inactivation of the Nat current, and vari- 
able n — 1, causing slow activation of the outward K* current. The latter and the 
leak current repolarize the membrane potential toward Vycst. 

When V is near Vyest, the voltage-sensitive time constants 7,(V) and 7,(V) are 
relatively large, as one can see in Fig.2.13. Therefore, recovery of variables n and h is 
slow. In particular, the outward Kt current continues to be activated (n is large) even 
after the action potential downstroke, thereby causing V to go below Vyes, toward Ex 
—a phenomenon known as afterhyperpolarization. 

In addition, the Na* current continues to be inactivated (h is small) and not avail- 
able for any regenerative function. The Hodgkin-Huxley system cannot generate an- 
other action potential during this absolute refractory period. While the current deinac- 
tivates, the system becomes able to generate an action potential, provided the stimulus 
is relatively strong (relative refractory period). 

To study the relationship between these refractory periods, we stimulate the Hodgkin- 
Huxley model with 1-ms pulses of current having various amplitudes and latencies. The 
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Figure 2.17: Refractory periods in the Hodgkin-Huxley model with J = 3. 


minimal amplitude of the stimulation needed to evoke a second spike in the model is 
depicted in Fig.2.17 (bottom). Notice that around 14 ms after the first spike, the model 
is hyper-excitable, that is, the stimulation amplitude is less than the baseline ampli- 
tude A, * 6 needed to evoke a spike from the resting state. This occurs because the 
Hodgkin-Huxley model exhibits damped oscillations of membrane potential (discussed 
in chapter 7). 


2.3.3. Propagation of the Action Potentials 


The space-clamped Hodgkin-Huxley model of the squid giant axon describes non- 
propagating action potentials since V(t) does not depend on the location, x, along 
the axon. To describe propagation of action potentials (pulses) along the axon hay- 
ing potential V(z,t), radius a (cm), and intracellular resistivity R (Q-cm), the partial 
derivative V,, is added to the voltage equation to account for axial currents along the 
membrane. The resulting nonlinear parabolic partial differential equation 


a 
OVi = op Vee ti —Ik—Ina— fh 


is often referred to as the Hodgkin-Huxley cable or propagating equation. Its important 
type of solution, a traveling pulse, is depicted in Fig.2.18. Studying this equation goes 


beyond the scope of this book; the reader can consult Keener and Sneyd (1998) and 
references therein. 
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Figure 2.18: Traveling pulse solution of the Hodgkin-Huxley cable equation at four 
successive moments. 


2.3.4 Dendritic Compartments 


Modifications of the Hodgkin-Huxley model, often called Hodgkin-Huxley-type models 
or conductance-based models, can describe the dynamics of spike-generation of many, 
if not all, neurons recorded in nature. However, there is more to the computational 
property of neurons than just the spike-generation mechanism. Many neurons have 
an extensive dendritic tree that can sample the synaptic input arriving at different 
locations and integrate it over space and time. 

Many dendrites have voltage-gated currents, so the synaptic integration is non- 
linear, sometimes resulting in dendritic spikes that can propagate forward to the soma 
of the neuron or backward to distant dendritic locations. Dendritic spikes are prominent 
in intrinsically bursting (IB) and chattering (CH) neocortical neurons considered in 
chapter 8. In that chapter we also model regular spiking (RS) pyramidal neurons, 
the most numerous class of neurons in mammalian neocortex, and show that their 
spike-generation mechanism is one of the simplest. The computation complexity of RS 
neurons must be hidden, then, in the arbors of their dendritic trees. 

It is not feasible at present to study the dynamics of membrane potential in dendritic 
trees either analytically or geometrically (i.e., without resort to computer simulations), 
unless dendrites are assumed to be passive (linear) and semi-infinite, and to satisfy 
Rall’s branching law (Rall 1959). Much of the insight can be obtained via simulations, 
which typically replace the continuous dendritic structure in Fig.2.19a with a network 
of discrete compartments in Fig.2.19b. Dynamics of each compartment is simulated by 
a Hodgkin-Huxley-type model, and the compartments are coupled via conductances. 
For example, if V,; and Vz denote the membrane potential at the soma and in the 
dendritic tree, respectively, as in Fig.2.19c, then 


C.V, =—I,(Ve,t)+9s(Va-Vs), and = CyVg = —Ia(Va,t) + ga(Vs — Va) , 
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Figure 2.19: A dendritic tree of a neuron (a) is replaced by a network of compart- 
ments (b), each modeled by a Hodgkin-Huxley-type model. The two-compartment 
neuronal model (c) may be equivalent to two neurons coupled via gap junctions (elec- 
trical synapse) (d). 


where each [(V,t) represents the sum of all voltage-, Ca**-, and time-dependent cur- 
rents in the compartment, and g, and gg are the coupling conductances that depend 
on the relative sizes of dendritic and somatic compartments. One can obtain many 
spiking and bursting patterns by changing the conductances and keeping all the other 
parameters fixed (Pinsky and Rinzel 1994, Mainen and Sejnowski 1996). 

Once we understand how to couple two compartments, we can do it for hundreds or 
thousands of compartments. GENESIS and NEURON simulation environments could 
be useful here, especially since they contain databases of dendritic trees reconstructed 
from real neurons. 


Interestingly, the somatic-dendritic pair in Fig.2.19c is equivalent to a pair of neu- 
rons in Fig.2.19d coupled via gap-junctions. These are electrical contacts that allow 
ions and small molecules to pass freely between the cells. Gap junctions are often 
called electrical synapses, because they allow potentials to be conducted directly from 
one neuron to another. 


Computational study of multi-compartment dendritic processing is outside of the 
scope of this book. We consider multi-compartment models of cortical pyramidal neu- 
rons in chapter 8 and gap-junction coupled neurons in chapter 10 (which is on the 
author’s webpage). 


2.3.5 Summary of Voltage-Gated Currents 


Throughout this book we model kinetics of various voltage-sensitive currents using the 
Hodgkin-Huxley gate model 


T= gm*h'(V —E) 
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Figure 2.20: Boltzmann (2.11) and Gaussian (2.12) functions and geometrical inter- 
pretations of their parameters. 


where 
I - current , (uA/cm?), 
V - membrane voltage, (mV), 
E - reverse potential, (mV), 
g  - maximal conductance, (mS/cm?), 
m_ - probability of activation gate to be open, 
h_ - probability of inactivation gate to be open, 
a - the number of activation gates per channel, 
6 -the number of inactivation gates per channel. 


The gating variables m and n satisfy linear first-order differential equations (2.9) and 
(2.10), respectively. We approximate the steady-state activation curve m..(V) by the 
Boltzmann function depicted in Fig.2.20, 


cb 


tes eee Ve 


(2.11) 


The parameter Vj /2 satisfies m..(Vi/2) = 0.5, and k is the slope factor (negative for the 
inactivation curve h..(V)). Smaller values of |k| result in steeper m(V). 

The voltage-sensitive time constant 7T(V) can be approximated by the Gaussian 
function 
—(Vinax = Vi 

a 
see Fig.2.20. The graph of the function is above Chase with amplitude Camp. The 
maximal value is achieved at Vax. The parameter 0 measures the characteristic width 
of the graph, that is, T(Vinax £7) = Chase + Camp/e- The Gaussian description is often 
not adequate, so we replace it with other functions whenever appropriate. 

Below is the summary of voltage-gated currents whose kinetics were measured ex- 
perimentally. The division into persistent and transient is somewhat artificial, since 
most “persistent” currents can still inactivate after seconds of prolonged depolarization. 
Hyperpolarization-activated currents, such as the h-current or Kt inwardly rectifying 
current, are mathematically equivalent to currents that are always activated, but can 
be inactivated by depolarization. To avoid possible confusion, we mark these currents 
“opened by hyperpolarization” . 


T(V) = Chase + Cate exp (2:12) 


? 
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Parameters (Fig.2.20) 


Na?* currents Eq. (2.11) Eq. (2.12) 
Vi /2 k Vmax 9 Camp Chase 

Fast transient ! Ina,t = gm?h(V — Ena) 

activation —40 15 —38 30. (0.46 0.04 

inactivation —62 —7 —67 20 7.4 1.2 
Fast transient ” Ina,t = 9 Moo(V)h(V — Ena) 

activation —30 5.0 - 

inactivation —70 —5.8 Tr(V) = 3exp((—40 — V)/33) 
Fast transient ? Ina,t = 9 Moo(V)h(V — Ena) 

activation —28 6.7 — 

inactivation —66 —6 Th(V) = 4exp((—30 — V)/29) 
Fast. persistent 4 INap = 9 Mao(V)hA(V — Ena) 

activation —50 4 — 

inactivation —A9 —10 —66 35 4.5 sec 2 sec 
Fast persistent °°? Inap = G§ Moo(V)(0.14 + 0.86h)(V — Ena) 

activation —50 6 - 

inactivation —56 —7 Th(V) = 63.2 + 25 exp(—V/25.5) 
Fast persistent ? Ivap = GM(V — Ena) 

activation —54 9 0.8 
Fast persistent © Ivap = GM(V — Ena) 

activation —42 4 0.8 

1. Squid giant axon (Hodgkin and Huxley 1952); see exercise 4. 

2. Thalamocortical neurons in rats (Parri and Crunelli 1999). 

3. Thalamocortical neurons in cats (Parri and Crunelli 1999). 

4. Layer-II principal neurons in entorhinal cortex (Magistretti and Alonso 1999). 

5. Large dorsal root ganglion neurons in rats (Baker and Bostock 1997, 1998). 

6. Purkinje cells (Kay et al. 1998). 


a Very slow inactivation. 
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Parameters (Fig.2.20) 


K* currents Eq. (2.11) Eq. (2.12) 
VY, /2 k Vinax 0 Camp Cises 

Delayed rectifier‘ Ik = gn*(V — Ex) 

activation —53 15 —79 50. 4.7 1.1 
Delayed rectifier?* IK = gmh(V — Ex) 

activation —3 10 —50 30 47 5 

inactivation —51 —12 —50 50 = 1000 360 
M current ® Ixy = 9 M(V — Ex) 

activation —44 8 —50 25 320 20 
Transient 4 In =Gmh(V — Ex) 

activation —3 20 —71 60 0.92 0.34 

inactivation —66 —10 —73 23 50 8 
Transient ° Ix, =gmh(V — Ex) 

activation —26 20 

inactivation —72 —9.6 15.5 
Transient ° In = gm*h(V — Ex) 
Fast component (60% of total conductance) 

activation —60 8.5 —58 25 2 0.37 

inactivation —78 —6 —78 25 45 19 
Slow component (40% of total conductance) 

activation —36 20 —58 25 2 0.37 

inactivation —78 —6 —78 25 45 19 


Inward rectifier 7 


T(V) = 60 when V > —73 


Tir = Ghoo(V)(V — Ex) 


(opened by hyperpolarization ) 


inactivation 


—80 —12 <1 


NOoap WN HR 


Squid giant axon (Hodgkin and Huxley 1952); see exercise 4. 

. Neocortical pyramidal neurons (Bekkers 2000). 

Rodent neuroblastoma-glioma hybrid cells (Robbins et al. 1992). 
. Neocortical pyramidal neurons (Korngreen and Sakmann 2000). 
. Hippocampal mossy fiber boutons (Geiger and Jonas 2000). 

. Thalamic relay neurons (Huguenard and McCormick 1992). 

. Horizontal cells in catfish retina (Dong and Werblin 1995); AP cell of leech (Wessel et. al. 


1999); rat locus coeruleus neurons (Williams et al. 1988, Vj/2 = Ex). 


AT 
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Parameters (Fig.2.20) 


Cation currents Eq. (2.11) Eq. (2:12) 
Vi /2 k Vinax 7 Camp Chase 

Ty current ! In =gh(V — &), Ey, = —48 mV 
(opened by hyperpolarization ) 

inactivation —75 —5.9 —75 15 1000 ~=100 
I, current ? In=Gh(V — Fy), Ey, =—-l1 mV 

inact. (soma) —82 —9 —75 20. ~=-50 10 

inact. (dendrite) —90 —8.5 —75 20 ~=40 10 
I, current ® In =gh(V — Ey), Ey = —21 mV 

fast inact. (65%) —67 —12 —75 30 50 20 

slow inact. (35%) —58 —9 —65 30 = 300 100 


1. Thalamic relay neurons (McCormick and Pape 1990; Huguenard and McCormick 1992). 
2. Hippocampal pyramidal neurons in CA1 (Magee 1998). 


3. Entorhinal cortex layer II neurons (Dickson et al. 2000). 
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Figure 2.21: Summary of current kinetics. Each oval (rectangle) denotes the voltage 
and temporal scale of activation (inactivation) of a current. Transient currents are 
represented by arrows connecting ovals and rectangles. 
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Figure 2.22: Alan Hodgkin (right) and Andrew Huxley (left) in their Plymouth Marine 
Lab in 1949. (Photo provided by National Marine Biological Library, Plymouth, UK). 


Review of Important Concepts 


Electrical signals in neurons are carried by Nat, Ca?*+, K*, and Cl- 
ions, which move through membrane channels according to their 
electrochemical gradients. 


The membrane potential V is determined by the membrane conduc- 
tances g; and corresponding reversal potentials E;: 


Neurons are excitable because the conductances depend on the mem- 
brane potential and time. 


The most accepted description of kinetics of voltage-sensitive con- 
ductances is the Hodgkin-Huxley gate model. 


Voltage-gated activation of inward Nat or Ca?* current depolarizes 
(increases) the membrane potential. 


Voltage-gated activation of outward K* or Cl” current hyperpolar- 
izes (decreases) the membrane potential. 


An action potential or spike is a brief regenerative depolarization of 
the membrane potential followed by its repolarization and possibly 
hyperpolarization, as in Fig.2.16. 
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Bibliographical Notes 


Our summary of membrane electrophysiology is limited: we present only those con- 
cepts that are necessary to understand the Hodgkin-Huxley description of generation 
of action potentials. We have omitted such important topics as the Goldman-Hodgkin- 
Katz equation, cable theory, dendritic and synaptic function, although some of those 
will be introduced later in the book. 

The standard textbook on membrane electrophysiology is the second edition of 
Ion Channels of Excitable Membranes by B. Hille (2001). An excellent introductory 
textbook with an emphasis on the quantitative approach is Foundations of Cellular 
Neurophysiology by D. Johnston and S. Wu (1995). A detailed introduction to math- 
ematical aspects of cellular biophysics can be found in Mathematical Physiology by 
J. Keener and J. Sneyd (1998). The latter two books complement rather than re- 
peat each other. Biophysics of Computation by Koch (1999) and chapters 5 and 6 of 
Theoretical Neuroscience by Dayan and Abbott (2001) provide a good introduction to 
biophysics of excitable membranes. 

The first book devoted exclusively to dendrites is Dendrites by Stuart et al. (1999). 
It emphasizes the active nature of dendritic dynamics. Arshavsky et al. (1971; Russian 
language edition, 1969) make the first, and probably still the best, theoretical attempt 
to understand the neurocomputational properties of branching dendritic trees endowed 
with voltage-gated channels and capable of generating action potentials. Had they 
published their results in the 1990s, they would have been considered classics in the 
field. Unfortunately, the computational neuroscience community of the 1970s was 
not ready to accept the “heretic” idea that dendrites can fire spikes, that spikes can 
propagate backward and forward along the dendritic tree, that EPSPs can be scaled-up 
with distance, that individual dendritic branches can perform coincidence detection and 
branching points can perform nonlinear summation, and that different and independent 
computations can be carried out at different parts of the neuronal dendritic tree. We 
touch on some of these issues in chapter 8. 


Exercises 


1. Determine the Nernst equilibrium potentials for the membrane of the squid giant 
axon using the following data: 


Inside (mM) Outside (mM) 
Ker 430 20 
Nat 50 440 
Cl- 65 560 


and T = 20°C. 
2. Show that a nonselective cation current 


I =Gnap(V — Ena) + Gx p(V — Ex) 
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OmV 
voltage steps 
-100 mV 
-10 mV 
-60 mV 
g Figure 2.23: Current traces 
oO . 
= corresponding to voltage steps 
of various amplitudes; see 
exercise 6. 
can be written in the form (2.7) with 
—— : GnaEna + GxE 
9 = Gna + 5K nel pots ui K 
9Na + 9K 


3. Show that applying a DC current J in the neuronal model 
CV =I g(V — Ey) — Lotner(V) 
is equivalent to changing the leak reverse potential Ey. 


4. Steady-state (in)activation curves and voltage-sensitive time constants can be 
approximated by the Boltzmann (2.11) and Gaussian (2.12) functions, respec- 
tively, depicted in Fig.2.20. Explain the meaning of the parameters V1/9, k, 
Chase, Camp; Vmax, and o and find their values that provide satisfactory fit near 
the rest state V = 0 for the Hodgkin-Huxley functions depicted in Fig.2.13. 


5. (Willms et al. 1999) Consider the curve m2,(V), where m.(V) is the Boltzmann 
function with parameters Vi/2 and k, and p > 1. This curve can be approximated 
by another Boltzmann function with some parameters V, yo and k (and p = 1). 
Find the formulas that relate Viy2 and k to Vij2, k, and p. 


6. (Willms et al. 1999) Write a MATLAB program that determines activation 
and inactivation parameters via a simultaneous fitting of current traces from a 
voltage-clamp experiment similar to the one in Fig.2.23. Assume that the values 
of the voltage pairs — e.g., —60, —10; —100,0 (mV) — are in the file v.dat. The 
values of the current (circles in Fig.2.23) are in the file current.dat, and the 
sampling times — e.g., 0, 0.25, 0.5, 1, 1.5, 2, 3, 5 (ms) — are in the file times. dat. 


7. Modify the MATLAB program from exercise 6 to handle multi-step (Fig.2.24) 
and ramp protocols. 


8. [M.S.] Find the best sequence of step potentials that can determine activa- 
tion and inactivation parameters (a) in the shortest time, (b) with the highest 
precision. 
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10. 


i; 


12. 
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+50 mV 

a aon ons Figure 2.24: Multiple voltage steps are of 
~ m . . 
“80 my ten needed to determine time constants of 
- m 7 A o ‘ 
-100 mV inactivation; see exercise 7. 


. [M.S.] Modify the MATLAB program from exercise 6 to handle multiple cur- 


rents. 


[M.S.] Add a PDE solver to the MATLAB program from exercise 6 to simulate 
poor space and voltage clamp conditions. 


[Ph.D.] Introduce numerical optimization into the dynamic clamp protocol to 
analyze experimentally in real time the (in)activation parameters of membrane 
currents. 


[Ph.D.] Use new classification of families of channels (Kv3,1, Nay1.2, etc.; see 
Hille 2001) to determine the kinetics of each subgroup, and provide a complete 
table similar to those in section 2.3.5. 


Chapter 3 


One-Dimensional Systems 


In this chapter we describe geometrical methods of analysis of one-dimensional dynam- 
ical systems, i.e., systems having only one variable. An example of such a system is 
the space-clamped membrane having Ohmic leak current J,: 


CYV. = —gi(V — E,) F (3.1) 


Here the membrane voltage V is a time-dependent variable, and the capacitance C, 
leak conductance g,, and leak reverse potential Ey, are constant parameters described 
in chapter 2. We use this and other one-dimensional neural models to introduce and 
illustrate the most important concepts of dynamical system theory: equilibrium, sta- 
bility, attractor, phase portrait, and bifurcation. 


3.1 Electrophysiological Examples 


The Hodgkin-Huxley description of dynamics of membrane potential and voltage-gated 
conductances can be reduced to a one-dimensional system when all transmembrane 
conductances have fast kinetics. For the sake of illustration, let us consider a space- 
clamped membrane having leak current and a fast voltage-gated current J, with only 
one gating variable p, 


Leak T, Teast 
CV = —g.(V-E.L)-gp(V —E) (3.2) 
P = (Pol(V)—p)/T(V) , (3.3) 


with dimensionless parameters C' = 1, gy = 1, and g = 1. Suppose that the gating 
kinetics (3.3) is much faster than the voltage kinetics (3.2), which means that the 
voltage-sensitive time constant 7(V) is very small, that is, 7(V) < 1 in the entire 
biophysical voltage range. Then the gating process may be treated as being instanta- 
neous, and the asymptotic value p = p.(V) may be used in the voltage equation (3.2) 
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Figure 3.1: Solution of the full system (3.2, 3.3) converges to that of the reduced 
one-dimensional system (3.4) as T(V) > 0. 


to reduce the two-dimensional system (3.2, 3.3) to a one-dimensional equation: 


instantaneous Least 


a. 
CV =—giV — Ex) — gPpxo(V)(V—E) . (3.4) 
This reduction introduces a small error of the order T(V) < 1, as one can see in Fig.3.1. 


Since the hypothetical current J;,, can be either inward (FE > E,,) or outward 
(E < E,), and the gating process can be either activation (p is m, as in the Hodgkin- 
Huxley model) or inactivation (p is h), there are four fundamentally different choices 
for Itase(V), which we summarize in Fig.3.2 and elaborate on below. 


Current Figure 3.2: Four fundamental examples of voltage- 
inward | outward | gated currents with one gating variable. In this 
book we treat “hyperpolarization-activated” cur- 
rents J, and Jxi, as inactivating currents, which 
are turned off (inactivated via h) by depolariza- 
tion and turned on (deinactivated) by hyperpolar- 
ization (see discussion in section 2.2.4). 


activation lige Ik 


Gating 


inactivation I, Jee 


3.1.1 I-V Relations and Dynamics 


The four choices in Fig.3.2 result in four simple one-dimensional models of the form 
(3.4): 
INa,p-model , [x-model , Iy-model, and  Jj,-model. 


These models might seem too simple to biologists, who can easily understand their 
behavior just by looking at the I-V relations of the currents depicted in Fig.3.3 without 
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currents 


inward outward 


(V) 


Figure 3.3: Typical current- 
voltage (I-V) relations of the four 
currents considered in this chap- 
ter. Shaded boxes correspond to 
nonmonotonic I-V relations hav- 
ing a region of negative conduc- 
tance (I'(V) < 0) in the biophys- 
ically relevant voltage range. 


activation, m 


gating 


inactivation, h 


using any dynamical systems theory. The models might also appear too simple to 
mathematicians, who can easily understand their dynamics just by looking at the 
graphs of the right-hand side of (3.4) without using any electrophysiological intuition. 
In fact, the models provide an invaluable learning tool, since they establish a bridge 
between electrophysiology and dynamical systems. 

In Fig.3.3 we plot typical steady-state current-voltage (I-V) relations of the four 
currents considered above. Note that the I-V curve is nonmonotonic for Ina, and Ikir 
but monotonic for Jk and J,, at least in the biophysically relevant voltage range. This 
subtle difference is an indication of the fundamentally different roles these currents 
play in neuron dynamics. The I-V relation in the first group has a region of “negative 
conductance” (i.e., I'(V) < 0), which creates positive feedback between the voltage and 
the gating variable (Fig.3.4), and plays an amplifying role in neuron dynamics. We 
refer to such currents as amplifying currents. In contrast, the currents in the second 
group have negative feedback between voltage and gating variable, and they often 
result in damped oscillation of the membrane potential, as we show in chapter 4. We 
refer to such currents as resonant currents. Most neural models involve a combination 
of at least one amplifying and one resonant current, as we discuss in chapter 5. The 
way these currents are combined determines whether the neuron is an integrator or a 
resonator. 


3.1.2 Leak + Instantaneous Iya,» 


To ease our introduction into dynamical systems, we will use the JNa,p-model 
instantaneous [Nap 
CV =1-g1(V — Ey) — Gna malV) (V — Ena) (3.5) 
called persistent sodium model, with 


Moo(V) = 1/(1 + exp {((Vij2 — V)/k}) 
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Figure 3.4: Feedback loops 
between voltage and_ gating 
variables in the four models pre- 


positive feedback, sented above (see also Fig.5.2). 
amplifying current 


inactivation, h 


throughout the rest of this chapter. (Some biologists refer to transient Na* currents 
with very slow inactivation as being persistent, since the current does not change much 
on the time scale of 1 sec.) We obtain the experimental parameter values 


C= 10 pF, I=0paA, tr, = 19 nb, Ey, = —67 mV, 
On, = (4.06, Vij2=15 mV, k=16 mV, Ex, = 60 mV 


using whole-cell patch-clamp recordings of a layer 5 pyramidal neuron in the visual 
cortex of a rat at room temperature. We prove in exercise 3.3.8 and illustrate in 
Fig.3.15 that the model approximates the action potential upstroke dynamics of this 
neuron. 
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derivative of membrane potential (mV/ms) 
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Figure 3.5: (a) I-V relations of the leak current J, fast Nat current Iya, and combined 
current [(V) = I,(V) + Ina(V) in the Inap-model (3.5). Dots denote [p9(V) data from 
layer 5 pyramidal cell in rat visual cortex. (b) The right-hand side of the [y,,)-model 
(3.5). 
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Figure 3.6: Typical voltage trajectories of the [y,p)-model (3.5) having different values 
of I. 


The model’s I-V relation, [(V), is depicted in Fig.3.5a. Due to the negative con- 
ductance region in the I-V curve, this one-dimensional model can exhibit a number 
of interesting nonlinear phenomena, such as bistability, i.e. coexistence of resting and 
excited states. From a mathematical point of view, bistability occurs because the 
right-hand-side function in the differential equation (3.5), depicted in Fig.3.5b, is not 
monotonic. In Fig.3.6 we depict typical voltage time courses of the model (3.5) with 
two values of injected DC current J and 16 different initial conditions. The qualita- 
tive behavior in Fig.3.6a is clearly bistable: depending on the initial condition, the 
trajectory of the membrane potential goes either up to the excited state or down to 
the resting state. In contrast, the behavior in Fig.3.6b is monostable, since the resting 
state does not exist. The goal of the dynamical system theory reviewed in this chapter 
is to understand why and how the behavior depends on the initial conditions and the 
parameters of the system. 


3.2 Dynamical Systems 
In general, dynamical systems can be continuous or discrete, depending on whether 


they are described by differential or difference equations. Continuous one-dimensional 
dynamical systems are usually written in the form 


V=F(V), V(@O)=HER. (3.6) 


For example, 


where V is a scalar time-dependent variable denoting the current state of the system, 
V = V, = dV /dt is its derivative with respect to time t, F’ is a scalar function (its 
output is one-dimensional) that determines the evolution of the system, e.g., the right- 
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Figure 3.7: Explicit analytical solution 
(V(t) = Ey + (Vo — Ex)e~™*/°) of the linear 
equation (3.1) and corresponding numerical 
approximation (dots) using Euler’s method (3.7). 


membrane potential, V 


hand side of (3.5) divided by C; see Fig.3.5b. Vo € R is an initial condition, and R is 
the real line, that is, a line of real numbers (IR” would be the n-dimensional real space). 

In the context of dynamical systems, the real line R is called the phase line or 
state line (phase space or state space for R”) to stress the fact that each point in R 
corresponds to a certain, possibly inadmissible state of the system, and each state of 
the system corresponds to a certain point in R. For example, the state of the Ohmic 
membrane (3.1) is its membrane potential V € R. The state of the Hodgkin-Huxley 
model (see section 2.3) is the four-dimensional vector (V,m,n,h) € R*. The state of 
the INa,p-model (3.5) is its membrane potential V € R, because the value m = m(V) 
is unequivocally defined by V. 

When all parameters are constant, the dynamical system is called autonomous. 
When at least one of the parameters is time-dependent, the system is nonautonomous, 
denoted as V = F(V,t). 

“To solve equation (3.6)” means to find a function V(t) whose initial value is V(0) = 
Vo and whose derivative is F'(V(t)) at each moment t > 0. For example, the function 
V(t) = Vo + at is an explicit analytical solution to the dynamical system V =a. The 
exponentially decaying function V(t) = Ey + (Vo — E,)e~%"/© depicted in Fig.3.7, a 
solid curve, is an explicit analytical solution to the linear equation (3.1). (Check by 
differentiating). 

Finding explicit solutions is often impossible even for such simple systems as (3.5), 
so quantitative analysis is carried out mostly via numerical simulations. The simplest 
procedure to solve (3.6) numerically, known as the first-order Euler method, replaces 
(3.6) with the discretized system 


[Vit+h) -V(E)|/h= FV) , 


where t = 0,h, 2h, 3h,..., is the discrete time and h is a small time step. Knowing the 
current state V(t), we can find the next state point via 


Vit+h) =V(t)+AF(V()) . (3:1) 
Iterating this difference equation starting with V(0) = Vo, we can approximate the 
analytical solution of (3.6) (see the dots in Fig.3.7). The approximation has a no- 


ticeable error of order h, so scientific software packages, such as MATLAB, use more 
sophisticated high-precision numerical methods. 
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In many cases, however, we do not need exact solutions, but qualitative understand- 
ing of the behavior of (3.6) and how it depends on parameters and the initial state Vo. 
For example, we might be interested in the number of equilibrium (rest) points the 
system could have, whether the equilibria are stable, their attraction domains, etc. 


3.2.1 Geometrical Analysis 


The first step in the qualitative geometrical analysis of any one-dimensional dynamical 
system is to plot the graph of the function F, as in Fig.3.8 (top). Since F(V) = V, 
at every point V where F'(V) is negative, the derivative V is negative, and hence the 
state variable V decreases. In contrast, at every point where F(V) is positive, V is 
positive, and the state variable V increases; the greater the value of F'(V), the faster 
V increases. Thus, the direction of movement of the state variable V, and hence the 
evolution of the dynamical system, is determined by the sign of the function F(V). 

The right-hand side of the Jjea,-model (3.1) or the [ya,p-model (3.5) in Fig.3.8 is the 
steady-state current-voltage (I-V) relation, [,(V) or I,(V)+Inap(V) respectively, taken 
with the minus sign, see Fig.3.5. Positive values of the right-hand-side F'(V) mean 
negative I-V, corresponding to a net inward current that depolarizes the membrane. 
Conversely, negative values mean positive I-V, corresponding to a net outward current 
that hyperpolarizes the membrane. 
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3.2.2 Equilibria 


The next step in the qualitative analysis of any dynamical system is to find its equzlabria 
or rest points, that is, the values of the state variable where 


HV 0) (V is an equilibrium). 


At each such point V = 0, the state variable V does not change. In the context of 
membrane potential dynamics, equilibria correspond to the points where the steady- 
state I-V curve passes zero. At each such point there is a balance of the inward and 
outward currents so that the net transmembrane current is zero, and the membrane 
voltage does not change. (Incidentally, the part libra in the Latin word aequilibrium 
means balance). 

The Ix- and J,-models mentioned in section 3.1 can have only one equilibrium 
because their I-V relations /(V ) are monotonic increasing functions. The corresponding 
functions F(V) are monotonic decreasing and can have only one zero. 

In contrast, the [Nap- and JKiy-models can have many equilibria because their I-V 
curves are not monotonic, and hence there is a possibility for multiple intersections 
with the V-axis. For example, there are three equilibria in Fig.3.8b corresponding to 
the resting state (around —53 mV), the threshold state (around —40 mV), and the 
excited state (around 30 mV). Each equilibrium corresponds to the balance of the 
outward leak current and partially (rest), moderately (threshold), or fully (excited) 
activated persistent Nat inward current. Throughout this book we denote equilibria 
as small open or filled circles, depending on their stability, as in Fig.3.8. 


3.2.3 Stability 


If the initial value of the state variable is exactly at equilibrium, then V = 0 and the 
variable will stay there forever. If the initial value is near the equilibrium, the state 
variable may approach the equilibrium or diverge from it. Both cases are depicted in 
Fig.3.8. We say that an equilibrium is asymptotically stable if all solutions starting 
sufficiently near the equilibrium will approach it as t > oo. 

Stability of an equilibrium is determined by the signs of the function F’ around 
it. The equilibrium is stable when F'(V) changes the sign from “plus” to “minus” as 
V increases, as in Fig.3.8a. Obviously, all solutions starting near such an equilibrium 
converge to it. Such an equilibrium “attracts” all nearby solutions, so it is called an 
attractor. A stable equilibrium point is the only type of attractor that can exist in one- 
dimensional continuous dynamical systems defined on a state line R. Multidimensional 
systems can have other attractors, e.g., limit cycles. 


The differences between stable, asymptotically stable, and exponentially stable 
equilibria are discussed in exercise 18 at the end of the chapter. The reader is also 
encouraged to solve exercise 4 (piecewise continuous F'(V)). 
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Figure 3.10: Two stable equilibrium points must be separated by at least one unstable 
equilibrium point because F'(V) has to change the sign from “minus” to “plus”. 


3.2.4 Eigenvalues 


A sufficient condition for an equilibrium to be stable is that the derivative of the 
function F' with respect to V at the equilibrium is negative, provided the function is 
differentiable. We denote this derivative here by 


A= F'(V), (V is an equilibrium; that is, F(V) = 0) 


and note that it is the slope of the graph of F’ at the point V (see Fig.3.9). Obviously, 
when the slope, A, is negative, the function changes the sign from “plus” to “minus”, 
and the equilibrium is stable. Positive slope implies instability. The parameter A 
defined above is the simplest example of an eigenvalue of an equilibrium. We introduce 
eigenvalues formally in chapter 4 and show that they play an important role in defining 
the types of equilibria of multidimensional systems. 


3.2.5 Unstable Equilibria 


If a one-dimensional system has two stable equilibrium points, then they must be 
separated by at least one unstable equilibrium point, as we illustrate in Fig.3.10. (This 
may not be true in multidimensional systems.) Indeed, a continuous function F’ has 
to change the sign from “minus” to “plus” somewhere in between those equilibria; 
that is, it has to cross the V-axis at some point, as in Fig.3.8b. This point would 
be an unstable equilibrium, since all nearby solutions diverge from it. In the context 
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Figure 3.11: Mechanistic inter- 
pretation of stable and unstable 
equilibria. A massless (inertia- 
free) ball moves toward energy 
minima with the speed propor- 
tional to the slope. A one- 
dimensional system V = F(V) 
has the energy landscape E(V) = 
=o F(v) dv (see exercise 17). 
Zeros of F'(V) with negative (pos- 
itive) slope correspond to minima 
(maxima) of E(V). 


of neuronal models, unstable equilibria lie in the region of the steady-state I-V curve 
with negative conductance. (Please, check that this is in accordance with the fact that 
F(V) = —-I(V)/C; see Fig.3.5.) An unstable equilibrium is sometimes called a repeller. 
Attractors and repellers have a simple mechanistic interpretation depicted in Fig.3.11. 


If the initial condition Vo is set to an unstable equilibrium point, then the solution 
will stay at this unstable equilibrium; that is, V(t) = Vo for all t, at least in theory. In 
practice, the location of an equilibrium point is known only approximately. In addition, 
small noisy perturbations that are always present in biological systems can make V(t) 
deviate slightly from the equilibrium point. Because of instability, such deviations will 
grow, and the state variable V(t) will eventually diverge from the repelling equilibrium 
the same way that the ball set at the top of the hill in Fig.3.11 will eventually roll 
downhill. If the level of noise is low, it could take a long time to diverge from the 
repeller. 


3.2.6 Attraction Domain 


Even though unstable equilibria are hard to see experimentally, they still play an im- 
portant role in dynamics, since they separate attraction domains. Indeed, the ball in 
Fig.3.11 could go left or right, depending on which side of the hilltop it is on initially. 
Similarly, the state variable of a one-dimensional system decreases or increases, de- 
pending on which side of the unstable equilibrium the initial condition is, as one can 
clearly see in Fig.3.8b. 

In general, the basin of attraction or attraction domain of an attractor is the set 
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Figure 3.12: Two attraction domains in a one-dimensional system are separated by the 
unstable equilibrium. 


of all initial conditions that lead to the attractor. For example, the attraction domain 
of the equilibrium in Fig.3.8a is the entire voltage range. Such an attractor is called 
global. In Fig.3.12 we plot attraction domains of two stable equilibria. The middle 
unstable equilibrium is always the boundary of the attraction domains. 


3.2.7 Threshold and Action Potential 


Unstable equilibria play the role of thresholds in one-dimensional bistable systems, i.e., 
in systems having two attractors. We illustrate this in Fig.3.13, which is believed to 
describe the essence of the mechanism of bistability in many neurons. Suppose the state 
variable is initially at the stable equilibrium point marked “state A” in the figure, and 
suppose that perturbations can kick it around the equilibrium. Small perturbations 
may not kick it over the unstable equilibrium so that the state variable continues to be 
in the attraction domain of “state A”. We refer to such perturbations as subthreshold. 

In contrast, we refer to perturbations as superthreshold (or suprathreshold) if they 
are large enough to push the state variable over the unstable equilibrium so that it 
becomes attracted to the “state B”. We see that the unstable equilibrium acts as a 
threshold that separates two states. 

The transition between two stable states separated by a threshold is relevant to the 
mechanism of excitability and generation of action potentials in many neurons, which 
is illustrated in Fig.3.14. In the Iyap-model (3.5) with the I-V relation in Fig.3.5 the 
existence of the resting state is largely due to the leak current J,,, while the existence 
of the excited state is largely due to the persistent inward Na* current Iya». Small 
(subthreshold) perturbations leave the state variable in the attraction domain of the 
rest state, while large (superthreshold) perturbations initiate the regenerative process — 
the upstroke of an action potential — and the voltage variable becomes attracted to the 
excited state. Generation of the action potential must be completed via repolarization, 
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Figure 3.13: Unstable equilibrium plays the role of a threshold that separates two 
attraction domains. 
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Figure 3.14: Mechanistic illus- 
tration of the mechanism of 
generation of an action potential. 


which moves V back to the resting state. Typically, repolarization occurs because of 
a relatively slow inactivation of Nat current and/or slow activation of an outward Kt 
current, which are not taken into account in the one-dimensional system (3.5). To 
account for such processes, we consider two-dimensional systems in the next chapter. 


Recall that the parameters of the [ya,)-model (3.5) were obtained from a cortical 
pyramidal neuron. In Fig.3.15 (left), we stimulate (in vitro) the cortical neuron by 
short (0.1 ms) strong pulses of current to reset its membrane potential to various 
initial values, and interpret the results using the JNa»-model. Since activation of the 
Na* current is not instantaneous in real neurons, we allow variable m to converge to 
Moo(V), and ignore the 0.3-ms transient activity that follows each pulse. We also ignore 
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Figure 3.15: Upstroke dynamics of layer 5 pyramidal neuron in vitro (compare with 
the Ina,p-model (3.5) in Fig.3.8b). 
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Figure 3.16: Membrane potential bistability in a cat TC neuron in the presence of 
ZD7288 (pharmacological blocker of J,. (Modified from Fig. 6B of Hughes et al. 1999). 
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Figure 3.17: Bistability and hysteresis loop as J changes. 


the initial segment of the downstroke of the action potential, and plot the magnification 
of the voltage traces in Fig.3.15 (right). Comparing this figure with Fig.3.8b we see that 
the INap-model is a reasonable one-dimensional approximation of the action potential 
upstroke dynamics. It predicts the value of the resting (—53 mV), the instantaneous 
threshold (—40 mV), and the excited (+30 mV) states of the cortical neuron. 


3.2.8 Bistability and Hysteresis 


Systems having two (many) coexisting attractors are called bistable (multistable). Many 
neurons and neuronal models, such as the Hodgkin-Huxley model, exhibit bistability 
between resting (equilibrium) and spiking (limit cycle) attractors. Some neurons can 
exhibit bistability of two stable resting states in the subthreshold voltage range, for 
example, —59 mV and —75 mV in the thalamocortical neurons (Hughes et al. 1999) 
depicted in Fig.3.16, or —50 mV and —60 mV in mitral cells of the olfactory bulb 
(Heyward et al. 2001), or —45 mV and —60 mV in Purkinje neurons. Brief inputs 
can switch such neurons from one state to the other, as in Fig.3.16. Though the 
ionic mechanisms of bistability are different in the three neurons, the mathematical 
mechanism is the same. 

Consider a one-dimensional system V = J + F(V) with function F(V) having a 
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cubic N-shape. Injection of a DC current J shifts the function J+ F'(V) up or down. 
When J is negative, the system has only one equilibrium, depicted in Fig.3.17a. As we 
remove the injected current J, the system becomes bistable, as in Fig.3.17b, but its state 
is still at the left equilibrium. As we inject positive current, the left stable equilibrium 
disappears via another saddle-node bifurcation, and the state of the system jumps to 
the right equilibrium, as in Fig.3.17c. But as we slowly remove the injected current 
that caused the jump and go back to Fig.3.17b, the jump to the left equilibrium does 
not occur until a much lower value corresponding to Fig.3.17a is reached. The failure 
of the system to return to the original value when the injected current is removed is 
called hysteresis. If I were a slow V-dependent variable, then the system could exhibit 
relaxation oscillations depicted in Fig.3.17d and described in the next chapter. 


3.3. Phase Portraits 


An important component in the qualitative analysis of any dynamical system is recon- 
struction of its phase portrait. It depicts all stable and unstable equilibria (as black 
and white circles, respectively), representative trajectories, and corresponding attrac- 
tion domains in the system’s state/phase space, as we illustrate in Fig.3.18. The phase 
portrait is a geometrical representation of system dynamics. It depicts all possible 
evolutions of the state variable and how they depend on the initial state. Looking at 
the phase portrait, one immediately gets all important information about the system’s 
qualitative behavior without even knowing the equation for F’. 


Phase Portrait 


Figure 3.18: Phase portrait of a one-dimensional system V = F (V). 
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Figure 3.19: Two “seemingly different” 
dynamical systems, V = F\(V) and 
V = F,(V), are topologically equiv- 
alent. Hence they have qualitatively 
similar dynamics. 
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Figure 3.20: Two “seemingly alike” 
dynamical systems V = F\(V) and 
V = FV) are not topologically 
equivalent, hence they do not have 
qualitatively similar dynamics. (The 
first system has three equilibria, while 
the second system has only one.) 


3.3.1 Topological Equivalence 


Phase portraits can be used to determine qualitative similarity of dynamical systems. 
In particular, two one-dimensional systems are said to be topologically equivalent when 
the phase portrait of one of them, treated as a piece of rubber, can be stretched or 
shrunk to fit the other one, as in Fig.3.19. Topological equivalence is a mathematical 
concept that clarifies the imprecise notion of “qualitative similarity”, and its rigorous 
definition is provided, for instance, by Guckenheimer and Holmes (1983). 

The stretching and shrinking of the “rubber” phase space are topological trans- 
formations that do not change the number of equilibria or their stability. Thus, two 
systems having different numbers of equilibria cannot be topologically equivalent and, 
hence, they have qualitatively different dynamics, as we illustrate in Fig.3.20. Indeed, 
the top system is bistable because it has two stable equilibria separated by an unsta- 
ble one. The evolution of the state variable depends on which attraction domain the 
initial condition is in initially. Such a system has “memory” of the initial condition. 
Moreover, sufficiently strong perturbations can switch it from one equilibrium state to 
another. In contrast, the bottom system in Fig.3.20 has only one equilibrium, which is 
a global attractor, and the state variable converges to it regardless of the initial con- 
dition. Such a system has quite primitive dynamics, and it is topologically equivalent 
to the linear system (3.1). 
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Figure 3.21: Hartman-Grobman theo- 
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is topologically equivalent to the linear 
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3.3.2 Local Equivalence and the Hartman-Grobman Theorem 


In computational neuroscience, we usually face quite complicated systems describing 
neuronal dynamics. A useful strategy is to replace such systems with simpler ones 
having topologically equivalent phase portraits. For example, both systems in Fig.3.19 
are topologically equivalent to V = V —V? (readers should check this), which is easier 
to deal with analytically. 

Quite often we cannot find a simpler system that is topologically equivalent to our 
neuronal model on the entire state line R. In this case, we make a sacrifice: we restrict 
our analysis to a small neighborhood of the line R (e.g., a neighborhood of the resting 
state or of the threshold), and study behavior locally in this neighborhood. 

An important tool in the local analysis of dynamical systems is the Hartman- 
Grobman theorem, which says that a nonlinear one-dimensional system 


V = F(V) 


sufficiently near an equilibrium V = Veg is locally topologically equivalent to the linear 
system 
V = XV — Veq) ; (3.8) 
provided the eigenvalue 
AS F"(Veq) 


at the equilibrium is nonzero, that is, the slope of F(V) is nonzero. Such an equilibrium 
is called hyperbolic. Thus, nonlinear systems near hyperbolic equilibria behave as if 
they were linear, as in Fig.3.21. 

It is easy to find the exact solution of the linearized system (3.8) with an initial 
condition V(0) = Vo. It is V(t) = Veg + e% (Vo — Veq) (readers should check by dif- 
ferentiating). If the eigenvalue A < 0, then e*’ > 0 and V(t) + Vig as t > 00, so 
that the equilibrium is stable. Conversely, if 1 > 0, then e** + oo meaning that the 
initial displacement, Vo — Veg, grows with time and the equilibrium is unstable. Thus, 
the linearization predicts qualitative dynamics at the equilibrium, and the quantitative 
rate of convergence/divergence to/from the equilibrium. 

If the eigenvalue A = 0, then the equilibrium is non-hyperbolic, and analysis of 
the linearized system V = 0 cannot describe the behavior of the nonlinear system. 
Typically, non-hyperbolic equilibria arise when the system undergoes a bifurcation, 
i.e., a qualitative change of behavior, which we consider next. To study stability, we 
need to consider higher-order terms of the Taylor series of F(V) at Veg. 
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Figure 3.22: Mechanistic illustra- 
tion of a bifurcation as a change 
of the landscape. 


3.3.3. Bifurcations 


The final and most advanced step in the qualitative analysis of any dynamical system 
is the bifurcation analysis. In general, a system is said to undergo a bifurcation when 
its phase portrait changes qualitatively. For example, the energy landscape in Fig.3.22 
changes so that the system is no longer bistable. The precise mathematical definition 
of a bifurcation will be given later. 

Qualitative change of the phase portrait may or may not necessarily reveal itself 
in a qualitative change of behavior, depending on the initial conditions. For example, 
there is a bifurcation in Fig.3.23 (left), but no change of behavior, because the ball 
remains in the attraction domain of the right equilibrium. To see the change, we 
need to drop the ball at different initial conditions and observe the disappearance of 
the left equilibrium. In the same veins, there is no bifurcation in Fig.3.23 (middle 
and right), — the phase portraits in each column are topologically equivalent, but the 
apparent change of behavior is caused by the expansion of the attraction domain of 
the left equilibrium or by the external input. Dropping the ball at different locations 
would result in the same qualitative picture — two stable equilibria whose attraction 
domains are separated by the unstable equilibrium. When mathematicians talk about 
bifurcations, they assume that all initial conditions could be sampled, in which case 
bifurcations do result in a qualitative change of behavior of the system as a whole. 

To illustrate the importance of sampling all initial conditions, let us consider the in 
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Figure 3.23: Bifurcations are not equivalent to qualitative change of behavior if the 
system is started with the same initial condition or subject to external input. 


vitro recordings of a pyramidal neuron in Fig.3.24. We inject 0.1-ms strong pulses of 
current of various amplitudes to set the membrane potential to different initial values. 
Right after each pulse, we inject a 4-ms step of DC current of amplitude J = 0, J = 16, 
or I = 60 pA. The case of J = 0 pA is the same as in Fig.3.15, so some initial conditions 
result in upstroke of the action potential, while others do not. When J = 60 pA, all 
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Figure 3.24: Qualitative change of the upstroke dynamics of a layer 5 pyramidal neuron 
from rat visual cortex (the same neuron as in Fig.3.15). 
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Figure 3.25: Bifurcation in the [Na»-model (3.5): The resting state and the threshold 
state coalesce and disappear when the parameter J increases. 


initial conditions result in the generation of an action potential. Clearly, a change of 
qualitative behavior occurs for some I between 0 and 60. 

To understand the qualitative dynamics in Fig.3.24, we consider the one-dimensional 
TNa,p-model (3.5) having different values of the parameter J and depict its trajectories 
in Fig.3.25. One can clearly see that the qualitative behavior of the model depends 
on whether J is greater or less than 16. When J = 0 (top of Fig.3.25), the system 
is bistable. The resting and the excited states coexist. When J is large (bottom of 
Fig.3.25) the resting state no longer exists because the leak outward current cannot 
balance the large injected DC current J and the inward Na* current. 

What happens when we change J past 16? The answer lies in the details of the 
geometry of the right-hand-side function F'(V) of (3.5) and how it depends on the 
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Figure 3.26: Saddle-node bifurcation: As the graph of the function F'(V) is lifted up, 
the stable and unstable equilibria approach each other, coalesce at the tangent point, 
and then disappear. 


parameter J. Increasing J elevates the graph of F'(V). The higher the graph of F'(V) is, 
the closer its intersections with the V-axis are, as we illustrate in Fig.3.26, which depicts 
only the low-voltage range of the system. When J approaches 16, the distance between 
the stable and unstable equilibria vanishes; the equilibria coalesce and annihilate each 
other. The value J = 16, at which the equilibria coalesce, is called the bifurcation 
value. This value separates two qualitatively different regimes. When I is near to but 
less than 16, the system has three equilibria and bistable dynamics. The quantitative 
features, such as the exact locations of the equilibria, depend on the particular values 
of J, but the qualitative behavior remains unchanged no matter how close I is to the 
bifurcation value. In contrast, when J is near to but greater than 16, the system has 
only one equilibrium and monostable dynamics. 

In general, a dynamical system may depend on a vector of parameters, say p. A 
point in the parameter space, say p = a, is said to be a regular or non-bifurcation 
point, if the system’s phase portrait at p = a is topologically equivalent to the phase 
portrait at p = c for any c sufficiently close to a. For example, the value J = 13 in 
Fig.3.26 is regular, since the system has topologically equivalent phase portraits for all 
I near 13. Similarly, the value J = 18 is also regular. Any point in the parameter space 
that is not regular is called a bifurcation point. Namely, a point p = 0 is a bifurcation 
point if the system’s phase portrait at p = b is not topologically equivalent to the phase 
portrait at a point p = c no matter how close c is to b. The value J = 16 in Fig.3.26 is 
a bifurcation point. It corresponds to the saddle-node (also known as fold or tangent) 
bifurcation for reasons described later. It is one of the simplest bifurcations considered 
in this book. 
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Figure 3.27: Geometrical illustration of the three conditions defining saddle-node bi- 
furcations. Arrows denote the direction of displacement of the function F'(V, J) as the 
bifurcation parameter J changes. 


3.3.4 Saddle-Node (Fold) Bifurcation 


In general, a one-dimensional system 


Ves El, 2); 


having an equilibrium point V = V,, for some value of the parameter I = Ig, (ie., 
F' (Ven, In) = 0), is said to be at a saddle-node bifurcation (sometimes called a fold 
bifurcation) if the following mathematical conditions, illustrated in Fig.3.27, are satis- 
fied: 


e Non-hyperbolicity. The eigenvalue at Vz, is zero; that is, 
A= FV) =O (at v= Vox) 


where Fy denotes the derivative of F' with respect to V, that is, Fy = OF /OV. 
Equilibria with zero or pure imaginary eigenvalues are called non-hyperbolic. 
Geometrically, this condition implies that the graph of F’ has horizontal slope at 
the equilibrium. 


e Non-degeneracy. The second-order derivative with respect to V at Vs, is nonzero; 
that is, 
Fyv(V, Jen.) # 0 (at V= Vea) 


Geometrically, this means that the graph of F' looks like the square parabola V? 
in Fig.3.27. 
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e Transversality. The function F'(V,/) is non-degenerate with respect to the bifur- 
cation parameter I; that is, 


PV ck aU) (atl cha); 


where fF; denotes the derivative of F’ with respect to J. Geometrically, this 
means that as J changes past J,,, the graph of F’ approaches, touches, and then 
intersects the V-axis. 


Saddle-node bifurcation results in appearance or disappearance of a pair of equilibria, 

as in Fig.3.26. None of the six examples on the right-hand side of Fig.3.27 can undergo 

a saddle-node bifurcation because at least one of the conditions above is violated. 
The number of conditions involving strict equality (“=”) is called the codimen- 

sion of a bifurcation. The saddle-node bifurcation has codimension-1 because there is 

only one condition involving “=”; the other two conditions involve inequalities (“A”). 

Codimension-1 bifurcations can be reliably observed in systems with one parameter. 
It is an easy exercise to check that the one-dimensional system 


Vara (3.9) 


is at saddle-node bifurcation when V = 0 and J = 0 (readers should check all three 
conditions). This system is called the topological normal form for saddle-node bifurca- 
tion. The phase portraits of this system are topologically equivalent to those depicted 
in Fig.3.26, except that the bifurcation occurs at J = 0, and not at J = 16. 


3.3.5 Slow Transition 


All physical, chemical, and biological systems near saddle-node bifurcations possess 
certain universal features that do not depend on particulars of the systems. Conse- 
quently, all neural systems near such a bifurcation share common neurocomputational 
properties, which we will discuss in detail in chapter 7. Here we take a look at one such 
property — slow transition through the ruins (or ghost) of the resting state attractor, 
which is relevant to the dynamics of many neocortical neurons. 

In Fig.3.28 we show the function F'(V) of the system (3.5) with J = 30 pA, which is 
greater than the bifurcation value 16 pA, and the corresponding behavior of a cortical 
neuron (compare with Fig.3.15). The system has only one attractor, the excited state, 
and any solution starting from an arbitrary initial condition should quickly approach 
this attractor. However, the solutions starting from the initial conditions around —50 
mV do not seem to hurry. Instead, they slow down near —46 mV and spend a con- 
siderable amount of time in the voltage range corresponding to the resting state, as if 
the state were still present. The closer J is to the bifurcation value, the more time the 
membrane potential spends in the neighborhood of the resting state. Obviously, such 
a slow transition cannot be explained by a slow activation of the inward Na* current, 
since Na* activation in a cortical neuron is practically instantaneous. 
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Figure 3.28: Slow transition through the ghost of the resting state attractor in a cortical 
pyramidal neuron with J = 30 pA (the same neuron as in Fig.3.15). Even though the 
resting state has already disappeared, the function F'(V), and hence the rate of change, 
V, is still small when V © —46 mV. 
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Figure 3.29: A 400-ms latency in a layer 5 pyramidal neuron of rat visual cortex. 


The slow transition occurs because the neuron or the system (3.5) in Fig.3.28 is 
near a saddle-node bifurcation. Even though J is greater than the bifurcation value, 
and the resting state attractor is already annihilated, the function F'(V) is barely above 
the V-axis at the “annihilation site”. In other words, the resting state attractor has 
already been ruined, but its “ruins” (or its “ghost”) can still be felt, because 


V =F(V) 0 (at attractor ruins, V ~ —46 mV), 


as one can see in Fig.3.28. In chapter 7 we will show how this property explains the 
ability of many neocortical neurons, such as the one in Fig.3.29, to generate repetitive 
action potentials with small frequency, and how it predicts that all such neurons, 
considered as dynamical systems, reside near saddle-node bifurcations. 
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Figure 3.30: Bifurcation diagram of the system in Fig.3.26. 


3.3.6 Bifurcation Diagram 


The final step in the geometrical bifurcation analysis of one-dimensional systems is the 
analysis of bifurcation diagrams, which we do in Fig.3.30 for the saddle-node bifurcation 
shown in Fig.3.26. To draw the bifurcation diagram, we determine the locations of the 
stable and unstable equilibria for each value of the parameter J and plot them as 
white or black circles in the (J, V) plane in Fig.3.30. The equilibria form two branches 
that join at the fold point corresponding to the saddle-node bifurcation (hence the 
alternative name fold bifurcation). The branch corresponding to the unstable equilibria 
is dashed to stress its instability. As the bifurcation parameter I varies from left to 
right, passing through the bifurcation point, the stable and unstable equilibria coalesce 
and annihilate each other. As the parameter varies from right to left, two equilibria 
— one stable and one unstable — appear from a single point. Thus, depending on 
the direction of movement of the bifurcation parameter, the saddle-node bifurcation 
explains disappearance or appearance of a new stable state. In any case, the qualitative 
behavior of the systems changes exactly at the bifurcation point. 


3.3.7 Bifurcations and I-V Relations 


In general, determining saddle-node bifurcation diagrams of neurons may be a daunting 
mathematical task. However, it is a trivial exercise when the bifurcation parameter is 
the injected DC current J. In this case, the bifurcation diagram, such as the one in 
Fig.3.30, is the steady-state I-V relation [,.(V) plotted on the (J,V)-plane. Indeed, 
the equation 


CV =I-I,.(V) =0 
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Figure 3.31: Equilibria are intersec- 

tions of the steady-state I-V curve 

-100 80 “60 “40 20 0 20 4 In.(V) and a horizontal line J = const. 
membrane potential, V (mV) 


states that V is an equilibrium if and only if the net membrane current, J — J,,(V), is 
zero. For example, equilibria of the [y,,p-model are solutions of the equation 


Tx.(V) 
EE 
0=I—(g1(V — Ex) + graMoo(V)(V — Ena)) ; 


which follows directly from (3.5). In Fig.3.31 we illustrate how to find the equilibria 
geometrically: We plot the steady-state I-V curve J,.(V) and draw a horizontal line 
with altitude 7. Any intersection satisfies the equation J = I,.(V), and hence is an 
equilibrium (stable or unstable). Obviously, when J increases past 16, the saddle-node 
bifurcation occurs. 

Note that the equilibria are points on the curve [,,(V), so flipping and rotating the 
curve by 90°, as we do in Fig.3.32 (left), results in a complete saddle-node bifurcation 
diagram. The diagram conveys all important information about the qualitative behay- 
ior of the [yq,p-model in a very condensed manner. The three branches of the S-shaped 


40; 1 40; Y 


: eS. 
cited 12 | 
_ 207 ee 2207 | | 
> saddle-node > 
E ot SS toid) biturcation | = EE gly &. 
af 2. Presp,, - ~ a 
3 aes "State ow 
= -20 ae rat = 
Tn. 50) 

°° Q, ° 
2 409 . fom 
- saddle-node 2 h 
§ (fold) bifurcation g 
— ~60/ a. 
oO ® 
& = 

-80+ a 

100; 

-1205 
-1000 -500 0 -1000 -500 0 
injected dc-current, | (pA) injected dc-current, | (pA) 


Figure 3.32: Bifurcation diagram of the [Na,p-model (3.5). 
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Figure 3.33: Bifurcation in the [yap-model (3.5). The excited state and the threshold 
state coalesce and disappear when the parameter IJ is sufficiently small. 


curve, which is the 90°-rotated and flipped copy of the N-shaped I-V curve, correspond 
to the resting, threshold, and excited states of the model. Each slice J = const repre- 
sents the phase portrait of the system, as we illustrate in Fig.3.32 (right). Each point 
where the branches fold (max or min of [,.(V)) corresponds to a saddle-node bifurca- 
tion. Since there are two such folds, at J = 16 pA and at J = —890 pA, there are two 
saddle-node bifurcations in the system. The first one, studied in Fig.3.25, corresponds 
to the disappearance of the resting state. The other one, illustrated in Fig.3.33, cor- 
responds to the disappearance of the excited state. It occurs because I becomes so 
negative that the Nat inward current is no longer strong enough to balance the leak 
outward current and the negative injected DC current to keep the membrane in the 
depolarized (excited) state. 


Below, the reader can find more examples of bifurcation analysis of the [y,- and 
Ixiy-models, which have nonmonotonic I-V relations and can exhibit multistability of 
states. The Jx- and [,-models have monotonic I-V relations, and hence only one 
equilibrium state. These models cannot have saddle-node bifurcations, as the reader 
is asked to prove in exercise 13 and 14. 
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Figure 3.34: Magnification of the I-V curve in Fig.3.31 at the left knee shows that it 
can be approximated by a square parabola. 


3.3.8 Quadratic Integrate-and-Fire Neuron 


Let us consider the topological normal form for the saddle-node bifurcation (3.9). From 
0 =I+4+V? we find that there are two equilibria, Viest = —4/|I| and Vitresh = +4/|J| 
when J < 0. The equilibria approach and annihilate each other via saddle-node bifur- 
cation when I = 0, so there are no equilibria when J > 0. In this case, V > J and V(t) 
increases to infinity. Because of the quadratic term, the rate of increase also increases, 
resulting in a positive feedback loop corresponding to the regenerative activation of the 
Na* current. In exercise 15 we show that V(t) escapes to infinity in a finite time, which 
corresponds to the upstroke of the action potential. The same upstroke is generated 
when I < 0, if the voltage variable is pushed beyond the threshold value Vinresh- 

Considering infinite values of the membrane potential may be convenient from a 
purely mathematical point of view, but this has no physical meaning and there is no 
way to simulate it on a digital computer. Instead, we fix a sufficiently large constant 
Voeak and say that (3.9) generated a spike when V(t) reached Vpeax. After the peak of 
the spike is reached, we reset V(t) to a new value Vyese,. The topological normal form 
for the saddle-node bifurcation with the after-spike resetting, 


V=I+V?, if V > Vpeox, then V — Vyeset (3.10) 


is called the quadratic integrate-and-fire neuron. It is the simplest model of a spiking 
neuron. The name stems from its resemblance to the leaky integrate-and-fire neuron 
V = 1-—YV considered in chapter 8. In contrast to the common folklore, the leaky 
neuron is not a spiking model because it does not have a spike generation mechanism, 
i.e., a regenerative upstroke of the membrane potential, whereas the quadratic neuron 
does. We discuss this and other issues in detail in chapter 8. 

In general, the quadratic integrate-and-fire model could be derived directly from 


the equation CV = I — I,.(V) through approximating the steady-state I-V curve near 
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Figure 3.35: Quadratic integrate-and-fire neuron (3.10) with time-dependent input. 


the resting state by the square parabola I,,.(V) © Ign. — k(V — Ven)?, where k > 0 and 
the peak of the curve (Ven, /gn) could easily be found experimentally (see Fig.3.34). 
Approximating the I-V curve by other functions — for example [,.(V) = gQieak(V — 
Viest) — ke?Y, results in other forms of the model, such as the exponential integrate- 
and-fire model (Fourcaud-Trocme et al. 2003), which has certain advantages over 
the quadratic form. Unfortunately, the model is not solvable analytically, and it is 
expensive to simulate. The form I.(V) = gieak(V — Vieak) — k(V — Vin)2., where z+ = x 
when « > 0 and x, = 0 otherwise, combines the advantages of both models. The 
parameters Vpeak aNd Vyese¢ are derived from the shape of the spike. Normalization of 
variables and parameters results in the form (3.10) with Vpeax = L. 

In Fig.3.35 we simulate the quadratic integrate-and-fire neuron to illustrate a num- 
ber of its features, which will be described in detail in subsequent chapters using 
conductance-based models. First, the neuron is an integrator; each input pulse in 
Fig.3.35 (top), pushes V closer to the threshold value; the higher the frequency of the 
input, the sooner V reaches the threshold and starts the upstroke of a spike. The neu- 
ron is monostable when Vyesee < 0 and can be bistable otherwise. Indeed, the first spike 
in Fig.3.35 (middle) is evoked by the input, but the subsequent spikes occur because 
the reset value is superthreshold. 

The neuron can be Class 1 or Class 2 excitable, depending on the sign of Vreset- 
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Suppose the injected current J slowly ramps up from a negative to a positive value. 
The membrane potential follows the resting state —4/|T| in a quasi-static fashion until 
the bifurcation point J = 0 is reached. At this moment, the neuron starts to fire tonic 
spikes. In the monostable case Vyeset < 0 in Fig.3.35 (bottom), the membrane potential 
is reset to the left of the ghost of the saddle-node point (see section 3.3.5), thereby 
producing spiking with an arbitrary small frequency, and hence Class 1 excitability. 
Because of the recurrence, such a bifurcation is called saddle-node on invariant circle. 
Many pyramidal neurons in mammalian neocortex exhibit such a bifurcation. In con- 
trast, in the bistable case Vyese, > 0, not shown in the figure, the membrane potential 
is reset to the right of the ghost, no slow transition is involved, and the tonic spiking 
starts with a nonzero frequency. (As an exercise, explain why there is a noticeable 
latency [delay] to the first spike right after the bifurcation.) This type of behavior is 
typical in spiny projection neurons of neostriatum and basal ganglia, as we show in 
chapter 8. 


Review of Important Concepts 


e The one-dimensional dynamical system V = F(V) describes how 
the rate of change of V depends on V. Positive F(V) means V 
increases; negative F'(V) means V decreases. 


In the context of neuronal dynamics, V is often the membrane po- 
tential, and F'(V) is the steady-state I-V curve taken with the minus 
sign. 


A zero of F(V) corresponds to an equilibrium of the system. (Indeed, 
if F(V) = 0, then the state of the system, V, neither increases nor 
decreases. ) 


An equilibrium is stable when F'(V) changes the sign from “plus” to 
“minus”. A sufficient condition for stability is that the eigenvalue 
\ = F'(V) at the equilibrium be negative. 


A phase portrait is a geometrical representation of the system’s dy- 
namics. It depicts all equilibria, their stability, representative tra- 
jectories, and attraction domains. 


A bifurcation is a qualitative change of the system’s phase portrait. 


The saddle-node (fold) is a typical bifurcation in one-dimensional 
systems. As a parameter changes, a stable and an unstable equilib- 
rium approach, coalesce, and then annihilate each other. 
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Bibliographical Notes 


There is no standard textbook on dynamical systems theory. The classic book Non- 
linear Oscillations, Dynamical Systems, and Bifurcations of Vector Fields by Gucken- 
heimer and Holmes (1983) plays the same role in the dynamical systems community 
as the book Jon Channels of Excitable Membranes by Hille (2001) plays in the neuro- 
science community. A common feature of these books is that they are not suitable for 
beginners. 

Most textbooks on differential equations, such as Differential Equations and Dy- 
namical Systems by Perko (1996), develop the theory starting with a comprehensive 
analysis of linear systems, then applying it to local analysis of nonlinear systems, and 
then discussing global behavior. To get to bifurcations, the reader has to go through 
a lot of daunting math, which is fun only for mathematicians. Here we follow an ap- 
proach similar to that in Nonlinear Dynamics and Chaos by Strogatz (1994). Instead 
of going from linear to nonlinear systems, we go from one-dimensional nonlinear sys- 
tems (this chapter) to two-dimensional nonlinear systems (next chapter). Rather than 
burdening the theory with a lot of mathematics, we use the geometrical approach to 
stimulate the reader’s intuition. (There is plenty of fun math in exercises and in later 
chapters. ) 


Exercises 


1. Consider a neuron having a Na* current with fast activation kinetics. Assume 
that inactivation of this current, as well as (in)activations of the other currents 
in the neuron are much slower. Prove that the initial segment of action poten- 
tial upstroke of this neuron can be approximated by the [ya,»-model (3.5). Use 
Fig.3.15 to discuss the applicability of this approximation. 


2. Draw phase portraits of the systems in Fig.3.36. Clearly mark all equilibria, their 
stability, attraction domains, and direction of trajectories. Determine the signs 
of eigenvalues at each equilibrium. 


F(V) F(V) F(V) 


\ awe. SA Ly 


Figure 3.36: Draw a phase portrait of the system V = F(V) with shown F(V). 


3. Draw phase portraits of the following systems: 


(a) c= —-1+4 2’, 
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Figure 3.37: Which of the pairs correspond to topologically equivalent dynamical sys- 
tems? (All intersections with the V-axis are marked as dots.) 


<< 


F,(V) Fy) 


Oy 


(b) cae a". 
Determine the eigenvalues at each equilibrium. 


4. Determine stability of the equilibrium x = 0 and draw phase portraits of the 
following piecewise continuous systems: 


(a) . | 2% neo 
7) a, ife>0 
—1, ifz<0 
(b) #«=2 0, ifx=0 
1, te SU 

. jf —2/2, if2 40 

tc) emf 0, ifa=0 


5. Draw phase portraits of the systems in Fig.3.37. Which of the pairs in the figure 
correspond to topologically equivalent dynamical systems? 


6. (Saddle-node bifurcation) Draw the bifurcation diagram and representative phase 
portraits of the system + = a+ x”, where a is a bifurcation parameter. Find the 
eigenvalues at each equilibrium. 


One-Dimensional Systems 85 


1 . 2 
F(V) 
08 h.(V) 
0.6 
0) 
0.4 
A 
0.2 
9 : -2 
-140 -70 0) z -100 -50 0) 
Membrane Voltage (mV) Membrane Voltage (mV) Membrane Voltage (mV) 


Figure 3.38: The Jx;,-model having injected current (J), leak current (J,,), and instan- 
taneous Kt inward rectifier current (xj) and described by (3.11). Inactivation curve 
h.(V) is modified from Wessel et al. (1999). Parameters: C = 1, I = 6, gy = 0.2, 
Ey, = —50, orn = 2, Ex = 80, Vio =—76, b = -12 (see Fig.2.20). 


7. (Saddle-node bifurcation) Use definition in section 3.3.4 to find saddle-node bi- 
furcation points in the following systems: 


at 2x + 2, 


—2x-+<2° (Hint: Verify the non-hyperbolicity condition first.), 


a 
t=1+ar42’, 
1 


+ 2x + az’, 
where a is the bifurcation parameter. 


8. (Pitchfork bifurcation) Draw the bifurcation diagram and representative phase 
portraits of the system « = br — x°, where 6 is a bifurcation parameter. Find the 
eigenvalues at each equilibrium. 


9. Draw the bifurcation diagram of the [x;,-model 
instantaneous Iki, 
CV =1- mV — By) - Guahoo(V WV — Ex) , (3.11) 
using parameters from Fig.3.38 and treating J as a bifurcation parameter. 


10. Derive an explicit formula that relates the position of the equilibrium in the 
Hodgkin-Huxley model to the magnitude of the injected DC current J. Are there 
any saddle-node bifurcations? 


11. Draw the bifurcation diagram of the [ya»-model (3.5), using parameters from 
Fig.3.39 and treating 
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Figure 3.39: The Iya,»-model with leak current (J;,) and persistent Na* current (Inap), 
described by (3.5) with the right-hand-side function F'(V). Parameters: C = 1, I = 0, 
gu = 1, Ey = —80, gna = 2.25, Eva = 60, Vij = —20, k = 15 (see Fig.2.20). 
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Figure 3.40: The Ix-model with leak current (J,,) and persistent K* current (Ix), 


described by (3.12). Parameters: C = 1, g, = 1, Ey, = —80, gx = 1, Ex = —90, 
Vio = —53, k = 15 (see Fig.2.20). 


(a) gp as a bifurcation parameter, or 
(b) Ey as a bifurcation parameter. 


12. Draw the bifurcation diagram of the [,;,-model (3.11), using parameters from 
Fig.3.38 and treating 


(a) gp as a bifurcation parameter, or 


(b) gxir as a bifurcation parameter. 


13. Show that the [x-model in Fig.3.40 


instantaneous Ix 


i 
CV =—g1(V — E,) — gxm4,(V)\(V — Ex) . (3.12) 


cannot exhibit saddle-node bifurcation for V > Ex. (Hint: Show that F’(V) 4 0 
for all V > Ex.) 
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Figure 3.41: The J,-model with leak current (J) and “hyperpolarization-activated” 
inward current J, described by (3.13). Parameters: C = 1, g, = 1, E, = —80, gn = 1, 
Ey, = —438, Vig = —75, k = —5.5 (Huguenard and McCormick 1992). 


14. Show that the J,-model in Fig.3.41, 
instantaneous fh, 
CV = -g1(V — Ex) — gulteo(V)(V — Ea) , (3.13) 
cannot exhibit saddle-node bifurcation for any V < Ey. 


15. Prove that the upstroke of the spike in the quadratic integrate-and-fire neuron 
(3.9) has the asymptote 1/(c — t) for some c > 0. 


16. (Cusp bifurcation) Draw the bifurcation diagram and representative phase por- 
traits of the system « = a + bx — x?, where a and b are bifurcation parameters. 
Plot the bifurcation diagram in the (a, b, z)-space and on the (a, b)-plane. 


17. (Gradient systems) An n-dimensional dynamical system « = f(x), with x = 
(%1,...,2n) € R” is said to be gradient when there is a potential (energy) function 
E(x) such that 


z= — grad E(x), 
where 
prad: Ft) = (gis vag 2g) 


is the gradient of E(x). Show that all one-dimensional systems are gradient. 
(Hint: See Fig.3.11.) Find potential (energy) functions for the following one- 
dimensional systems 


(a) V=0, (b) V=1, (c) 
(4) V=-14+V?, =) V 


vanv, 
V=-—sinV. 


18. Consider a dynamical system « = f(x) , x(0) = 20. 


(a) Stability. An equilibrium y is stable if any solution x(t) with xo sufficiently 
close to y remains near y for all time. That is, for all ¢ > 0 there exists 
6 > 0 such that if |zo — y| < 6 then |x(t) — y| < ¢ for allt > 0. 
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(b) Asymptotic stability. A stable equilibrium y is asymptotically stable if all 
solutions starting sufficiently close to y approach it as t + oo. That is, if 
6d > 0 can be chosen from the definition above so that lim;,. x(t) = y. 


(c) Exponential stability. A stable equilibrium y is said to be exponentially 
stable when there is a constant a > 0 such that |x(t) — y| < exp(—at) for all 
Xp near y and all t > 0. 


Prove that (c) implies (b), and (b) implies (a). Show that (a) does not imply 
(b) and (b) does not imply (c). That is, present a system having stable but not 
asymptotically stable equilibrium, and a system having asymptotically but not 
exponentially stable equilibrium. 


(Iympa-model) Show that voltage-dependent activation of NMDA synaptic re- 
ceptors in a passive dendritic tree with a constant concentration of glutamate is 
mathematically equivalent to the [Na,p-model. 


Chapter 4 


Two-Dimensional Systems 


In this chapter we introduce methods of phase plane analysis of two-dimensional sys- 
tems. Most concepts will be illustrated using the [ya»)+JK-model in Fig.4.1: 


leak Ty, instantaneous [Nap Ik 
i —eS_— OCC eee OO 
CV = I-gi(V—E_L) — gna Mo(V) (V— Ena) — xn (V—-Ex) , (4.1) 


having leak current [,,, persistent Nat current Iya» with instantaneous activation ki- 
netic and a relatively slower persistent Kt current Ix with either high (Fig.4.1a) or low 
(Fig.4.1b) threshold (the two choices result in fundamentally different dynamics). The 
state of the Iya»+JK-model is a two-dimensional vector (V,n) € R? on the phase plane 
R?. New types of equilibria, orbits, and bifurcations can exist on the phase plane that 
cannot exist on the phase line R. Many interesting features of single neuron dynamics 
can be illustrated or explained using two-dimensional systems. Even neuronal bursting, 
which occurs in multidimensional systems, can be understood via bifurcation analysis 
of two-dimensional systems. 

This model is equivalent in many respects to the well-known and widely used 
Ica+Ix-model proposed by Morris and Lecar (1981) to describe voltage oscillations 
in the barnacle giant muscle fiber. 


4.1 Planar Vector Fields 


Two-dimensional dynamical systems, also called planar systems, are often written in 
the form 


= f(x 


3¥ ef 
= g(a;y) ; 


where the functions f and g describe the evolution of the two-dimensional state variable 
(x(t), y(t)). For any point (xo, yo) on the phase plane, the vector (f (Xo, yo), 9(£0, Yo)) 
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Figure 4.1: The INap+/x-model (4.1, 4.2). Parameters in (a): C = 1, ] =0, Ey = —80 
mV, gL = 8, gna = 20, gk = 10, Mo(V) has Vio = —20 and k = 15, no(V) has 
Viso = —25 and k = 5, and 7(V) = 1, Ena = 60 mV and Ex = —90 mV. Parameters 
in (b) as in (a) except Ey, = —78 mV and n..(V) has Vi/2 = —45; see section 2.3.5. 


Figure 4.2: Harold Lecar (back), Richard 
FitzHugh (front), and Cathy Morris at 
NIH Biophysics Lab, summer of 1983. 
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indicates the direction of change of the state variable. For example, negative f (Zo, yo) 
and positive g(%o, yo) imply that x(t) decreases and y(t) increases at this particular 


point. Since each point on the phase plane (xz, y) has its own vector (f,g), the system 


above is said to define a vector field on the plane, also known as a direction field or 


a velocity field, see Fig.4.3. Thus, the vector field defines the direction of motion; 


depending on where you are, it tells you where you are going. 


Let us consider a few examples. The two-dimensional system 


d 


i 
0 


——— 
y= 


defines a constant horizontal vector field in Fig.4.3a because each point has a horizontal 


vector (1,0) attached to it. 


Similarly, the system 


(Of course, we depict only a small sample of vectors.) 


defines a constant vertical vector field depicted in Fig.4.3b. The system 
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defines a vector field that points to the origin (0,0), as in Fig.4.3c, and the system 


CS Sys (4.3) 
y= -2 (4.4) 


defines a saddle vector field, as in Fig.4.3d. Vector fields provide geometrical infor- 
mation about the joint evolution of state variables. For example, the vector field in 
Fig.4.3d is directed rightward in the lower half-plane and leftward in the upper half- 
plane. Therefore the variable x(t) increases when y < 0 and decreases otherwise, which 
obviously follows from equation (4.3). Quite often, however, geometrical analysis of 
vector fields can provide information about the behavior of the system that may not 
be obvious from the form of the functions f and g. 


4.1.1 Nullclines 


The vector field in Fig.4.3d is directed rightward (x increases) or leftward (x decreases) 
in different regions of the phase plane. The set of points where the vector field changes 
its horizontal direction is called the x-nullcline, and it is defined by the equation 
f(x,y) = 0. Indeed, at any such point x neither increases nor decreases because 
x = 0. The x-nullcline partitions the phase plane into two regions where x moves in 
opposite directions. Similarly, the y-nullcline is defined by the equation g(x,y) = 0, 
and it denotes the set of points where the vector field changes its vertical direction. 
This nullcline partitions the phase plane into two regions where y either increases or 
decreases. The x- and y-nullclines partition the phase plane into four different regions: 
(a) x and y increase, (b) x decreases and y increases, (c) x and y decrease, and (d) x 
increases and y decreases, as we illustrate in Fig.4.4. 

Each point of intersection of the nullclines is an equilibrium point, since f(x,y) = 
g(x,y) =0, and hence « = y = 0. Conversely, every equilibrium of a two-dimensional 
system is the point of intersection of its nullclines. Because nullclines are so important, 
we consider two examples in detail below (the reader is urged to solve exercise 1 at the 
end of this chapter). 

Let us determine nullclines of the system (4.3, 4.4) with the vector field shown in 
Fig.4.3d. From (4.3) it follows that the x-nullcline is the horizontal line y = 0, and 
from (4.4) it follows that the y-nullcline is the vertical line x = 0. These nullclines 
(dashed lines in Fig.4.3d) partition the phase plane into four quadrants, in each of 
which the vector field has a different direction. The intersection of the nullclines is 
the equilibrium (0,0). Later in this chapter we will study how to determine stability 
of equilibria in two-dimensional systems, though in this particular case one can easily 
guess that the equilibrium is not stable. 

As another example, let us determine the nullclines of the Iya p,+J«-model (4.1, 
4.2). The V-nullcline is given by the equation 


I — gi(V —Ex) — gna Moo(V) (V—Ena) — 9xn(V—Ex) =0, 
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which has the solution 


I = gu(V —Ex) — gna Moo(V) (VV —Ena) 
n= V-nullcline) , 
gx (V — Ex) 


depicted in Fig.4.4. It typically has the form of a cubic parabola. The equation 
Nxo(V) —-n=0 


defines the n-nullcline 


= Nel V) (n-nullcline), 


which coincides with the Kt steady-state activation function n,.(V), though only an 
initial segment of this curve fits in Fig.4.4. It is easy to see how the V- and n-nullclines 


partition the phase plane into four regions, in each of which the vector field has a 
different direction: 


(a) Both V and n increase. Both Nat and Kt currents activate and lead to the 
upstroke of the action potential. 


(b) V decreases but n still increases. The Na* current deactivates, but the slower 
K* current still activates and leads to the downstroke of the action potential. 


(c) Both V and n decrease. Both Nat and Kt currents deactivate while V is small, 
leading to a refractory period. 


(d) V increases but n still decreases. Partial activation of the Na* current combined 
with further deactivation of the residual Kt current leads to a relative refractory 
period, then to an excitable period, and possibly to another action potential. 
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The intersection of the V- and n-nullclines in Fig.4.4 is an equilibrium corresponding 
to the resting state. The number and location of equilibria may be difficult to infer 
via analysis of equations (4.1, 4.2), but it is a trivial geometrical exercise once the 
nullclines are determined. Because nullclines are so useful and important in geometrical 
analysis of dynamical systems, few scientists bother to plot vector fields. Following this 
tradition, we will not show vector fields in the rest of the book (except for this chapter). 
Instead, we plot nullclines and representative trajectories, which we discuss next. 


4.1.2 Trajectories 


A vector function (x(t), y(t)) is a solution of the two-dimensional system 


= g(x, ) 


starting with an initial condition (x(0), y(0)) = (xo, yo) when dx(t)/dt = f (x(t), y(t)) 
and dy(t)/dt = g(x(t), y(t)) at each t > 0. This requirement has a simple geometrical 
interpretation: a solution is a curve (x(t), y(t)) on the phase plane R? which is tangent 
to the vector field, as we illustrate in Fig 4.5. Such a curve is often called a trajectory 
or an orbit. 

One can think of the vector field as a stationary flow of a fluid. Then a solution 
is just a trajectory of a small particle dropped at a certain (initial) point and carried 
by the flow. To study the flow, it is useful to drop a few particles and see where they 
are going. Thus, to understand the geometry of a vector field, it is always useful to 
plot a few representative trajectories starting from various initial points, as we do in 
Fig.4.6. Due to the uniqueness of the solutions, the trajectories cannot cross, so they 
partition or foliate the phase space. This is an important step toward determining the 
phase portrait of a two-dimensional system. 

Let us return to the INap»+/«-model (4.1, 4.2) with low-threshold K* current and 
explain two odd phenomena discussed in chapter 1: Failure to generate all-or-none 
action potentials (Fig.1.5b) and inability to have a fixed value of the threshold voltage. 
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Figure 4.5: Solutions are trajectories tangent to the vector field. 
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Brief and strong current pulses in Fig.4.7 reset the value of the voltage variable V but 
do not change the value of the Kt activation variable n. Thus, each voltage trace after 
the pulse corresponds to a trajectory starting with different values of Vo but the same 
value no. We see that each trajectory makes a counterclockwise excursion and returns 
to the resting state. However, the size of the excursion depends on the initial value of 
the voltage variable and can be small (subthreshold response), intermediate, or large 
(action potential). This phenomenon was considered theoretically by FitzHugh in the 
early 1960s (see bibliography) and demonstrated experimentally by Cole et al. (1970), 
using the squid giant axon at higher than normal temperatures. 
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Figure 4.7: Failure to generate all-or-none action potentials in the [Nap»+J/k-model. 
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Figure 4.8: Failure to have a fixed value of threshold voltage in the [ya,+J«-model. 


In Fig.4.8 we apply a long pre-pulse current of various amplitudes to reset the 
K* activation variable n to various values, and then a brief strong pulse to reset V to 
exactly —48 mV. Each voltage trace after the pulse corresponds to a trajectory starting 
with the same Vo = —48 mV, but different values of no. We see that some trajectories 
return immediately to the resting state, while others do so after generating a transient 
action potential. Therefore, V = —48 mV is a subthreshold value when no is large, and 
a superthreshold value otherwise. In particular, the system does not have a clear-cut 
voltage threshold — a ubiquitous property of many neurons. 


4.1.3. Limit Cycles 


A trajectory that forms a closed loop is called a periodic trajectory or a periodic orbit 
(the latter is usually reserved for mappings, which we do not consider here). Some- 
times periodic trajectories are isolated, as in Fig.4.9, and sometimes they are part of a 
continuum, as in Fig.4.13 (left). An isolated periodic trajectory is called a limit cycle. 
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Figure 4.10: Stable limit cycle in the Iya »+Jk-model (4.1, 4.2) with low-threshold K* 
current and J = 40. 


The existence of limit cycles is a major feature of two-dimensional systems that cannot 
exist in R'. If the initial point is on a limit cycle, then the solution (x(t), y(t)) stays 
on the cycle forever, and the system exhibits periodic behavior; that is, 


z(t) = 2(t+T) and =e y(t) = y(t + T) (for all t) 


for some 7’ > 0. The minimal 7 for which this equality holds is called the period 
of the limit cycle. A limit cycle is said to be asymptotically stable if any trajectory 
with the initial point sufficiently near the cycle approaches the cycle as t + oo. Such 
asymptotically stable limit cycles are often called limit cycle attractors, since they 
“attract” all nearby trajectories. The stable limit cycle in Fig.4.9 is an attractor. 
The limit cycle in Fig.4.10 is also an attractor; it corresponds to the periodic (tonic) 
spiking of the INap+Jx-model (4.1, 4.2). The unstable limit cycle in Fig.4.9 is often 
called a repeller, since it repels all nearby trajectories. Notice that there is always at 
least one equilibrium inside any limit cycle on a plane. 
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Figure 4.11: Limit cycles corresponding to tonic spiking of three types of neurons 
recorded in vitro. 


In Fig.4.11 we depict limit cycles of three types of neurons recorded in vitro. Since 
we do not know the state of the internal variables, such as the magnitude of the 
activation and inactivation of Nat and K* currents, we plot the cycles on the (V, V’)- 
plane, where V’ is the time derivative of V. The cycles look jerky because of the poor 
data sampling rate during each spike. 


4.1.4 Relaxation Oscillators 


Many models in science and engineering can be reduced to two-dimensional fast /slow 
systems of the form 


c= F139) (fast variable) 
= poy) (slow variable) , 


where the small parameter ju describes the ratio of time scales of variables x and y. 
Typically, the fast variable x has a cubic like nullcline that intersects the y-nullcline 
somewhere in the middle branch, as in Fig.4.12a, resulting in relaxation oscillations. 
The periodic trajectory of the system slides down along the left (stable) branch of the 
cubic nullcline until it reaches the left knee, A. At this moment, it quickly jumps to 
point B and then slowly slides up along the right (also stable) branch of the cubic 
nullcline. Upon reaching the right knee, C, the system jumps to the left branch and 
starts to slide down again, thereby completing one oscillation. Relaxation oscillations 
are easy to grasp conceptually, but some of their features are quite difficult to study 
mathematically. (We consider relaxation oscillations in detail in section 6.3.4). 

Note that the jumps in Fig.4.12a are nearly horizontal — a distinctive signature of 
relaxation oscillations that is due to the disparately different time scales in the system. 
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Figure 4.12: Relaxation oscillations in the van der Pol model # = 2 —2?/3-—y, y = px 
with uw = 0.01. 


Although many neuronal models have fast and slow time scales and could be reduced 
to the fast/slow form above, they do not exhibit relaxation oscillations because the 
parameter py is not small enough. Anybody who records from neurons would probably 
notice the weird square shape of “spikes” in Fig.4.12b, something that most biological 
neurons do not exhibit. Nevertheless, relaxation oscillations in fast/slow systems are 
important when we consider neuronal bursting in chapter 9; the fast variable x is 
two-dimensional there. 


4.2 Equilibria 


An important step in the analysis of any dynamical system is to find its equilibria, 
that is, points where 


f(z,y) = 0, 


lea (point (x,y) is an equilibrium). 
g(x,y) = 0 


As mentioned before, equilibria are intersections of nullclines. If the initial point (29, yo) 
is an equilibrium, then « = 0 and y = 0, and the trajectory stays at equilibrium; that 
is, x(t) = x and y(t) = yo for all t > 0. If the initial point is near the equilibrium, 
then the trajectory may converge to or diverge from the equilibrium, depending on its 
stability. 

From the electrophysiological point of view, any equilibrium of a neuronal model 
is the zero crossing of its steady-state I-V relation J,.(V). For example, the Ina p»p+/k- 
model (4.1, 4.2) with high-threshold K* current has an I-V curve with three zeroes 
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Figure 4.13: Neutrally stable equilibria. Some trajectories neither converge to nor 
diverge from the equilibria. 
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Figure 4.14: Unstable equilibria. 


(Fig.4.la); hence it has three equilibria: around —66 mV, —56 mV, and —28 mV. In 
contrast, the same model with low-threshold K* current has a monotonic I-V curve 


with only one zero (Fig.4.1b); hence it has a unique equilibrium, which is around —61 
mV. 


4.2.1 Stability 


In chapter 3, exercise 18, we provide rigorous definitions of stability of equilibria in 
one-dimensional systems. The same definitions apply to higher-dimensional systems. 
Briefly, an equilibrium is stable if any trajectory starting sufficiently close to the equi- 
librium remains near it for all t > 0. If, in addition, all such trajectories converge 
to the equilibrium as t + oo, the equilibrium is asymptotically stable, as in Fig.4.3c. 
When the convergence rate is exponential or faster, then the equilibrium is said to 
be exponentially stable. Note that stability does not imply asymptotic stability. For 
example, all equilibria in Fig.4.13 are stable but not asymptotically stable. They are 
often referred to as neutrally stable. 

An equilibrium is called unstable, if it is not stable. Obviously, if all nearby trajec- 
tories diverge from the equilibrium, as in Fig.4.14a, then it is unstable. This, however, 
is an exceptional case. For instability it suffices to have at least one trajectory that 
diverges from the equilibrium no matter how close the initial condition is to the equi- 
librium, as in Fig.4.14b. Indeed, any trajectory starting in the shaded area (attraction 
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domain) converges to the equilibrium, but any trajectory starting in the white area 
diverges from it, regardless of how close the initial point is to the equilibrium. 

In contrast to the one-dimensional case, the stability of a two-dimensional equilib- 
rium cannot be inferred from the slope of the steady-state I-V curve. For example, 
the equilibrium around —28 mV in Fig.4.1a is unstable even though the I-V curve has 
positive slope. 

To determine the stability of an equilibrium, we need to look at the behavior of 
the two-dimensional vector field in a small neighborhood of the equilibrium. Quite 
often visual inspection of the vector field does not give conclusive information about 
stability. For example, is the equilibrium in Fig.4.4 stable? What about the equilibrium 
in Fig.4.10? The vector fields in the neighborhoods of the two equilibria exhibit subtle 
differences that are difficult to spot without the help of analytical tools, which we 
discuss next. 


4.2.2 Local Linear Analysis 


Below we remind the reader of some basic concepts of linear algebra, assuming that 
he or she has some familiarity with matrices, eigenvectors, and eigenvalues. Consider 
a two-dimensional dynamical system 
t= f(x,y) (4.5) 
y = g(z,y) (4.6) 


having an equilibrium point (xo, yo). The nonlinear functions f and g can be linearized 
near the equilibrium; that is, written in the form 


f(@,y) = a(x —2o0) + b(y — yo) + higher-order terms, 


g(x,y) = c(x— 20) + d(y — yo) + higher-order terms, 


where higher-order terms include (x — x9)”, (% — 29)(y — yo), (v¥ — 0), and so on, and 


O O 
a= TH 05, yo) b= Fe (to, 30) 
Og Og 


c= Dy (tor Yos d= By TOO) 


are the partial derivatives of f and g with respect to the state variables x and y 
evaluated at the equilibrium (20, yo). (First, evaluate the derivatives, then substitute 
xX = Xo and y = yp; if you do in the opposite order, you will always get zero). Many 
questions regarding the stability of the equilibrium can be answered by considering the 
corresponding linear system 


a = au+bu, (4.7) 
b = cut+du, (4.8) 
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where u = x — Xp and w = y — yo are the deviations from the equilibrium, and the 
higher-order terms u?, ww, w?, and so on, are neglected. We can write this system in 


the vector form 
Ne as 0 u 
wo Nee ad wi) 
a Od 
ale 


is called the Jacobian matrix of the system (4.5, 4.6) at the equilibrium (Zo, yo). For 
example, the Jacobian matrix of the system (4.3, 4.4) at the origin is 


( = i ) . (4.9) 


It is important to remember that Jacobian matrices are defined for equilibria, and 
that a nonlinear system can have many equilibria, and hence many different Jacobian 
matrices. 


The linearization matrix 


4.2.3. Eigenvalues and Eigenvectors 


A nonzero vector uv € R? is said to be an eigenvector of the matrix L corresponding to 
the eigenvalue if 
Lv = dv (matrix notation) . 


For example, the matrix (4.9) has two eigenvectors, 


o=(7) and w=( 4), 


corresponding to the eigenvalues A, = —1 and A» = 1, respectively. Any textbook on 
linear algebra explains how to find eigenvectors and eigenvalues of an arbitrary matrix. 
It is important for the reader to get comfortable with these notions, since they are used 
extensively in the rest of the book. 

Eigenvalues play an important role in the analysis of stability of equilibria. To find 
the eigenvalues of a 2x 2-matrix L, one solves the characteristic equation 


a—X2 b 
det ( . gf) ot 


This equation can be written in the polynomial form (a — »)(d — A) — be = 0 or 
Mw —TrA+A=0, 


where 
=e baad and A = det L = ad — be 
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are the trace and the determinant of the matrix L, respectively. Such a quadratic 
polynomial has two solutions of the form 


pial ah ee are 


Ay = 5) and 2 = 5) ; (4.10) 


and they are either real (when rT? —4A > 0) or complex-conjugate (when 7?— 4A < 0). 
What can you say about the case 7? = 4A? 

In general, 2 x 2 matrices have two eigenvalues with distinct (independent) eigen- 
vectors. In this case a general solution of the linear system has the form 


ult 
( (¢) ) = cye™v, + coe™* vy , 


where c; and Cy, are constants that depend on the initial condition. This formula is valid 
for real and complex-conjugate eigenvalues. When both eigenvalues are negative (or 
have negative real parts), u(t) > 0 and w(t) > 0, meaning x(t) > xo and y(t) > yo, 
so that the equilibrium (29, yo) is exponentially (and hence asymptotically) stable. It is 
unstable when at least one eigenvalue is positive or has a positive real part. We denote 
stable equilibria by filled circles e and unstable equilibria by open circles o throughout 
the book. 


4.2.4 Local Equivalence 


An equilibrium whose Jacobian matrix does not have zero eigenvalues or eigenvalues 
with zero real parts is called hyperbolic. Such an equilibrium can be stable or unstable. 
The Hartman-Grobman theorem states that the vector field, and hence the dynamics 
of a nonlinear system, such as (4.5, 4.6), near such a hyperbolic equilibrium is topolog- 
ically equivalent to that of its linearization (4.7, 4.8). That is, the higher-order terms 
that are neglected when (4.5, 4.6) is replaced by (4.7, 4.8) do not play any qualitative 
role. Thus, understanding and classifying the geometry of vector fields of linear sys- 
tems provides an exhaustive description of all possible behaviors of nonlinear systems 
near hyperbolic equilibria. 

A zero eigenvalue (or eigenvalues with zero real parts) arises when the equilibrium 
undergoes a bifurcation, as in Fig.4.14b; such equilibria are called non-hyperbolic. 
Linear analysis cannot answer the question of stability of a nonlinear system in this 
case, since small nonlinear (high-order) terms play a crucial role here. We denote 
equilibria undergoing a bifurcation by half-filled circles, ©. 


4.2.5 Classification of Equilibria 


Besides defining the stability of an equilibrium, the eigenvalues also define the geometry 
of the vector field near the equilibrium, as we illustrate in Fig.4.15, and as the reader 
is asked to prove in exercise 4. (The proof is a straightforward consequence of (4.10).) 
There are three major types of equilibria. 
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Figure 4.15: Classification of equilibria according to the trace (7) and the determinant 
(A) of the Jacobian matrix L. The shaded region corresponds to stable equilibria. 


Node (Fig.4.16). The eigenvalues are real and of the same sign. The node is stable 
when the eigenvalues are negative, and unstable when they are positive. The 
trajectories tend to converge to or diverge from the node along the eigenvector 
corresponding to the eigenvalue having the smallest absolute value. 


Saddle (Fig.4.17). The eigenvalues are real and of opposite signs. Saddles are always 
unstable, since one of the eigenvalues is always positive. Most trajectories ap- 
proach the saddle equilibrium along the eigenvector corresponding to the negative 
(stable) eigenvalue and then diverge from it along the eigenvector corresponding 
to the positive (unstable) eigenvalue. 


Focus (Fig.4.18). The eigenvalues are complex-conjugate. Foci are stable when the 
eigenvalues have negative real parts, and unstable when the eigenvalues have pos- 
itive real parts. The imaginary part of the eigenvalues determines the frequency 
of rotation of trajectories around the focus equilibrium. 


When the system undergoes a saddle-node bifurcation, one of the eigenvalues becomes 
zero and a mixed type of equilibrium occurs — saddle-node equilibrium, illustrated in 
Fig.4.14b. There could be other types of mixed equilibria, such as saddle-focus or 
focus-node, and so on, in dynamical systems having dimension 3 and higher. 
Depending upon the value of the injected current J, the INa,+J«-model (4.1, 4.2) 
with a low-threshold K* current has a stable focus (Fig.4.8) or an unstable focus 
(Fig.4.10) surrounded by a stable limit cycle. In Fig.4.19 we depict the vector field 
and nullclines of the same model with a high-threshold K* current. As one expects 
from the shape of the steady-state I-V curve in Fig.4.1a, the model has three equilibria: 
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Figure 4.16: Node equilibrium occurs when both eigenvalues are real and have the 
same sign, for example, 43 = —1 and Ay = —3 (stable) or A; = +1 and »» = +3 
(unstable). Most trajectories converge to or diverge from the node along the eigenvector 
v, corresponding to the eigenvalue having the smallest absolute value. 
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Figure 4.17: Saddle equilibrium occurs when two real eigenvalues have opposite signs, 
such as A; = +1 and Ay = —1. Most trajectories diverge from the equilibrium along 
the eigenvector corresponding to the positive eigenvalue (in this case, v;). 
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Figure 4.18: Focus equilibrium occurs when the eigenvalues are complex-conjugate, for 
instance, A = —3 +i (stable) or \ = +3 +i (unstable). The imaginary part (here, 1) 
determines the frequency of rotation around the focus. 
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Figure 4.19: Phase portrait of the INap+Jx-model having high-threshold Kt current. 


a stable node, a saddle, and an unstable focus. Notice that the third equilibrium is 
unstable even though the I-V relation has a positive slope around it. 

Also notice that the y-axis starts at the negative value -0.1. However, the gating 
variable n represents the proportion (probability) of the K* channels in the open state; 
hence a value less than zero has no physical meaning. So while we can happily calculate 
the nullclines for the negative n, and even start the trajectory with the initial condition 
n <0, we cannot interpret the result. (As an exercise, prove that if all gating variables 
of a model are initially in the range [0,1], then they stay in the range for all t > 0.) 


4.2.6 Example: FitzHugh-Nagumo Model 


The FitzHugh-Nagumo model (FitzHugh 1961; Nagumo et al. 1962; Izhikevich and 
FitzHugh 2006) 


V = Via-V\(V-1)-w+ I, (4.11) 
w= bWV—cw, (4.12) 


imitates generation of action potentials by Hodgkin-Huxley-type models having cubic 
(N-shaped) nullclines, as in Fig.4.4. Here V mimics the membrane voltage and the 
“recovery” variable w mimics activation of an outward current. Parameter J mimics 
the injected current, and for the sake of simplicity we set J = 0 in our analysis below. 
Parameter a describes the shape of the cubic parabola V(a—V)(V —1), and parameters 
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Figure 4.20: Nullclines in the FitzHugh-Nagumo model (4.11, 4.12). Parameters: J = 
0,b = 0.01, c = 0.02, a = 0.1 (left) and a = —0.1 (right). 


b > 0 and c > 0 describe the kinetics of the recovery variable w. When b and c are 
small, the model may exhibit relaxation oscillations. 
The nullclines of the FitzHugh-Nagumo model have the cubic and linear form 


w=V(a-V)\(V—-1)4+1 (V-nullcline), 
w= b/cV (w-nullcline), 


and they can intersect in one, two, or three points, resulting in one, two, or three 
equilibria, all of which may be unstable. Below, we consider the simple case I = 0, so 
that the origin, (0,0), is an equilibrium. Indeed, the nullclines of the model, depicted 
in Fig.4.20, always intersect at (0,0) in this case. The intersection may occur on the 
left (Fig.4.20a) or middle (Fig.4.20b) branch of the cubic V-nullcline, depending on the 
sign of the parameter a. Let us determine how the stability of the equilibrium (0,0) 
depends on the parameters a, b, and c. 

There is a common dogma that the equilibrium in Fig.4.20a corresponding to a > 0 
is always stable, the equilibrium in Fig.4.20b corresponding to a < 0 is always unstable, 
and the loss of stability occurs “exactly” at a = 0, that is, at the bottom of the left 
knee. Let us check that this is not necessarily true, at least when c 4 0. The Jacobian 
matrix of the FitzHugh-Nagumo model (4.11,4.12) at the equilibrium (0,0) has the 


form 
—a —l 
z= ( se 


7r=trLb=-a-c and A=detL=ac+b. 


It is easy to check that 


Using Fig.4.15, we conclude that the equilibrium is stable when tr L < 0 and det L > 0, 
which corresponds to the shaded region in Fig.4.21. Both conditions are always satisfied 
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Figure 4.21: Stability diagram of the 
equilibrium (0,0) in the FitzHugh- 
a Nagumo model (4.11,4.12). 


when a > 0; hence the equilibrium in Fig.4.20a is indeed stable. However, since both 
conditions may also be satisfied for negative a, the equilibrium in Fig.4.20b may also 
be stable. Thus, the equilibrium loses stability not at the left knee, but slightly to the 
right of it, so that a part of the “unstable branch” of the cubic nullcline is actually 
stable. The part is small when b and c are small, i-e., when (4.11,4.12) is in a relaxation 
regime. 


4.3. Phase Portraits 


An important step in geometrical analysis of dynamical systems is sketching their phase 
portraits. The phase portrait of a two-dimensional system is a partitioning of the 
phase plane into orbits or trajectories. Instead of depicting all possible trajectories, it 
usually suffices to depict some representative trajectories. The phase portrait contains 
all important information about qualitative behavior of the dynamical system, such 
as relative location and stability of equilibria, their attraction domains, separatrices, 
limit cycles, and other special trajectories that are discussed in this section. 


4.3.1 Bistability and Attraction Domains 


Nonlinear two-dimensional systems can have many coexisting attractors. For example, 
the FitzHugh-Nagumo model (4.11,4.12) with nullclines depicted in Fig.4.22 has two 
stable equilibria separated by an unstable equilibrium. Such a system is called bistable 
(multi-stable when there are more than two attractors). Depending on the initial 
conditions, the trajectory may approach the left or the right equilibrium. The shaded 
area denotes the attraction domain of the right equilibrium; that is, the set of all 
initial conditions that lead to this equilibrium. Since there are only two attractors, 
the complementary white area denotes the attraction domain of the other equilibrium. 
The domains are separated not by equilibria, as in the one-dimensional case, but by 
special trajectories called separatrices, which we discuss in section 4.3.2. 

Many neural models are bistable or can be made bistable when the parameters have 
appropriate values. Often bistability results from the coexistence of an equilibrium 
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Figure 4.22: Bistability of two equilibrium attractors (black circles) in the FitzHugh- 


Nagumo model (4.11,4.12). The shaded area — attraction domain of the right equilib- 
rium. Parameters: J = 0, b=0.01, a=c=0.1. 


attractor corresponding to the resting state and a limit cycle attractor corresponding 
to the repetitive firing state. Figure 4.23 depicts one of many possible cases. Here 
we use the Iyap+/k-model with a high-threshold fast K* current. The resting state 
exists due to the balance of partially activated Nat and leak currents. The repetitive 
spiking state persists because the Kt current deactivates too fast and cannot bring the 
membrane potential into the subthreshold voltage range. If the initial state is in the 
shaded area, which is the attraction domain of the limit cycle attractor, the trajectory 


approaches the limit cycle attractor and the neuron fires an infinite train of action 
potentials. 


4.3.2 Stable/Unstable Manifolds 


In contrast with one-dimensional systems, in two-dimensional systems unstable equilib- 
ria do not necessarily separate attraction domains. Nevertheless, they play an impor- 
tant role in defining the boundary of attraction domains, as in Fig.4.22 and Fig.4.23. 
In both cases the attraction domains are separated by a pair of trajectories, called 
separatrices, which converge to the saddle equilibrium. Such trajectories form the 
stable manifold of a saddle point. Locally, the manifold is parallel to the eigenvector 
corresponding to the negative (stable) eigenvalue; see Fig.4.24. Similarly, the unstable 
manifold of a saddle is formed by the two trajectories that originate exactly from the 
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Bistability of rest and spiking states in the Iya»+J«-model (4.1, 4.2) with 
high-threshold fast (7(V) = 0.152) Kt current and J = 3. A brief strong pulse of 
current (arrow at t = 5 ms) brings the state vector of the system into the attraction 
domain of the stable limit cycle. 
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Figure 4.24: Stable and unstable manifolds to a saddle. The eigenvectors v; and v2 
correspond to positive and negative eigenvalues, respectively. 
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saddle (or approach the saddle if the time is reversed). Locally, the unstable manifold 
is parallel to the eigenvector corresponding to the positive (unstable) eigenvalue. 

The stable manifold of the saddle in Fig.4.23 plays the role of a threshold, since 
it separates resting and spiking states. We illustrate this concept in Fig.4.24: if the 
initial state of the system, denoted as A, is in the shaded area, the trajectory will 
converge to the spiking attractor (right) no matter how close the initial condition is to 
the stable manifold. In contrast, if the initial condition, denoted as B, is in the white 
area, the trajectory will converge to the resting attractor (left). If the initial condition 
is precisely on the stable manifold (point C), the trajectory converges neither to resting 
nor to spiking, but to the saddle equilibrium. Of course, this case is highly unstable, 
and small perturbations will certainly push the trajectory to one side or the other. 
The important message in Fig.4.24 is that a threshold is not a point, i.e., a single 
voltage value, but a trajectory on the phase plane. (Find an exceptional case where 
the threshold looks like a single voltage value. Hint: See Fig.4.17.) 


4.3.3. Homoclinic/Heteroclinic Trajectories 


Figure 4.24 shows that trajectories forming the unstable manifold originate from the 
saddle. Where do they go? Similarly, the trajectories forming the stable manifold 
terminate at the saddle. Where do they come from? We say that a trajectory is 
heteroclinic if it originates at one equilibrium and terminates at another equilibrium, 
as in Fig.4.25. A trajectory is homoclinic if it originates and terminates at the same 
equilibrium. These types of trajectories play an important role in geometrical analysis 
of dynamical systems. 

Heteroclinic trajectories connect unstable and stable equilibria, as in Fig.4.26, and 
they are ubiquitous in dynamical systems having two or more equilibrium points. In 
fact, there are infinitely many heteroclinic trajectories in Fig.4.26, since all trajectories 
inside the bold loop originate at the unstable focus and terminate at the stable node. 
(Find the exceptional trajectory that ends elsewhere.) 

In contrast, homoclinic trajectories are rare. First, a homoclinic trajectory diverges 
from an equilibrium, so the equilibrium must be unstable. Next, the trajectory makes 
a loop and returns to the same equilibrium, as in Fig.4.27. It needs to hit the unsta- 
ble equilibrium precisely, since a small error would make it deviate from the unstable 
equilibrium. Though uncommon, homoclinic trajectories indicate that the system un- 
dergoes a bifurcation — appearance or disappearance of a limit cycle. The homoclinic 
trajectory in Fig.4.27 indicates that the limit cycle in Fig.4.23 is about to (dis)appear 


Figure 4.25: A heteroclinic orbit starts 
and ends at different equilibria. A ho- 
moclinic orbit starts and ends at the 
same equilibrium. 
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Figure 4.26: Two heteroclinic orbits (bold curves connecting stable and unstable equi- 
libria) in the INa»+J«K-model with high-threshold K* current. 
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Figure 4.27: Homoclinic orbit (bold) in the Iya,+Jx-model with high-threshold fast 
(r(V) = 0.152) Kt current. 
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Figure 4.28: Homoclinic orbit (bold) to saddle-node equilibrium in the Iya.p)+/k-model 
with high-threshold Kt current and J = 4.51. 


via saddle homoclinic orbit bifurcation. The homoclinic trajectory in Fig.4.28 indi- 
cates that a limit cycle is about to (dis)appear via saddle-node on invariant circle 
bifurcation. We study these bifurcations in detail in chapter 6. 


4.3.4 Saddle-Node Bifurcation 


In Fig.4.29 we simulate the injection of a ramp current J into the Iya»+Jx-model 
having high-threshold Kt current. Our goal is to understand the transition from the 
resting state to repetitive spiking. When J is small, the phase portrait of the model 
is similar to the one depicted in Fig.4.26 for J = 0. There are two equilibria in the 
low-voltage range — a stable node corresponding to the resting state and a saddle. The 
equilibria are the intersections of the cubic V-nullcline and the n-nullcline. Increasing 
the parameter J changes the shape of the cubic nullcline and shifts it upward, but does 
not change the n-nullcline. As a result, the distance between the equilibria decreases, 
until they coalesce as in Fig.4.28 so that the nullclines touch each other only in the 
low-voltage range. Further increase of J results in the disappearance of the saddle and 
node equilibrium, and hence in the disappearance of the resting state. The new phase 
portrait is depicted in Fig.4.30; it has only a limit cycle attractor corresponding to 
repetitive firing. We see that increasing I past the value J = 4.51 results in transition 


from resting to periodic spiking dynamics. What kind of bifurcation occurs when 
i=451? 
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Figure 4.29: Transition from resting state to repetitive spiking in the [Na »+J/«-model 
with injected ramp current I (see also Fig.4.26, Fig.4.28, and Fig.4.30). Note that the 
frequency of spiking is initially small, then increases as the amplitude of the injected 
current increases. 
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Figure 4.30: Limit cycle attractor (bold) in the Iya p»+/«-model when J = 10 (compare 
with Fig.4.26 and 4.28). 
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Figure 4.31: Saddle-node bifurcation: The saddle and node equilibria approach each 
other, coalesce, and annihilate each other (shaded area is the basin of attraction of the 
stable node). 


Those readers who did not skip section 3.3.3 in chapter 3 will immediately recognize 
the saddle-node bifurcation, whose major stages are summarized in Fig.4.31. As a 
bifurcation parameter changes, the saddle and the node equilibrium approach each 
other, coalesce, and then annihilate each other so there are no equilibria left. When 
they coalesce, the joint equilibrium is neither a saddle nor a node, but a saddle-node. 
Its major feature is that it has precisely one zero eigenvalue, and it is stable on one side 
of the neighborhood and unstable on the other side. In chapter 6 we will provide an 
exact definition of a saddle-node bifurcation in a multi-dimensional system, and will 
show that there are two important subtypes of this bifurcation, resulting in slightly 
different neurocomputational properties. 


It is a relatively simple exercise to determine bifurcation diagrams for saddle-node 
bifurcations in neuronal models. For this, we just need to determine all equilibria of 
the model and how they depend on the injected current J. Any equilibrium of the 
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Figure 4.32: Saddle-node bifurcation diagram of the [Nap»+J/k-model. The curve is 
given by the equation (4.13). 


IvNa,p+Ik-model satisfies the one-dimensional equation 
0=I—gi(V—Ex) — gna Moo(V) (V—Ena) — 9k No (V) (V—Ex) , 


where n = n(V). Instead of solving this equation for V, we use V as a free parameter 
and solve it for J, 


steady-state [,,.(V) 
— 00" 
I= gL(V — Ey) + gna Moo(V) (V—Ena) + 9K No (V) (V—Ex) , (4.13) 


and then depict the solution as a curve in the (J,V) plane in Fig.4.32. In the magni- 
fication (Fig.4.32, right) one can clearly see how two branches of equilibria approach 
and annihilate each other as J approaches the bifurcation value 4.51. (Is there any 
other saddle-node bifurcation in the figure?) 


4.3.5 Andronov-Hopf Bifurcation 


In Fig.4.33 we repeat the current ramp experiment, using the [y,,)+/«-model with a 
low-threshold Kt current. The phase portrait of such a model is simple — it has a 
unique equilibrium, as we illustrate in Fig.4.34. When J is small, the equilibrium is a 
stable focus corresponding to the resting state. When J increases past J = 12, the focus 
loses stability and gives birth to a small-amplitude limit cycle attractor. The amplitude 
of the limit cycle grows as J increases. We see that increasing J beyond J = 12 results 
in the transition from resting to spiking behavior. What kind of bifurcation occurs 
there? 

Recall that stable foci have a pair of complex-conjugate eigenvalues with negative 
real part. When J increases, the real part of the eigenvalues also increases until it 
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Figure 4.33: Transition from resting state to repetitive spiking in the [Na »+J/«-model 
with ramp injected current J; see also Fig.4.34 (small-amplitude noise is added to the 
model to mask the slow passage effect). Note that the frequency of spiking is relatively 
constant for a wide range of injected current. 
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Figure 4.34: Supercritical Andronoyv-Hopf bifurcation in the Iy,)+Jx-model (4.1, 4.2) 
with low-threshold K* current when J = 12 (see also Fig.4.33). 
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Figure 4.35: Andronov-Hopf bifurcation diagram in the [y,,+Jx-model with low- 
threshold K* current. a. Equilibria of the model (solution of (4.13)). b. Equilibria 
and limit cycles of the model. 


becomes zero (at J = 12) and then positive (when J > 12), meaning that the focus 
is no longer stable. The transition from stable to unstable focus described above is 
called the Andronov-Hopf bifurcation. It occurs when the eigenvalues become purely 
imaginary, as happens when J = 12. We will study Andronov-Hopf bifurcations in 
detail in chapter 6, where we will show that they can be supercritical or subcritical. 
The former correspond to birth of a small-amplitude limit cycle attractor, as in Fig.4.34. 
The latter correspond to the death of an unstable limit cycle. 

In Fig.4.35a we plot the solution of (4.13) as an attempt to determine the bifurcation 
diagram for the Andronov-Hopf bifurcation in the [ya,+J/x-model. However, all we 
can see is that the equilibrium persists as J increases, but there is no information on 
its stability or on the existence of a limit cycle attractor. To study the limit cycle 
attractor, we need to simulate the model with various values of parameter J. For 
each J, we disregard the transient period and plot min V(t) and max V(t) on the 
(1,V)-plane, as in Fig.4.35b. When J is small, the solutions converge to the stable 
equilibrium, and both min V(t) and max V(t) are equal to the resting voltage. When 
I increases past J = 12, the min V(t) and max V(t) values start to diverge, meaning 
that there is a limit cycle attractor whose amplitude increases as J does. This method 
is appropriate for analysis of supercritical Andronov-Hopf bifurcations, but it fails for 
subcritical Andronov-Hopf bifurcations. (Why?) 

Figure 4.36 depicts an interesting phenomenon observed in many biological neurons, 
excitation block. Spiking activity of the layer 5 pyramidal neuron of rat’s visual cortex 
is blocked by strong excitation (i.e., injection of strong depolarizing current). The 
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Figure 4.36: Excitation block in layer 5 pyramidal neuron of rat’s visual cortex as the 
amplitude of the injected current ramps up. 


geometry of this phenomenon is illustrated in Fig.4.37 (bottom). As the magnitude 
of the injected current increases, the unstable equilibrium, which is the intersection 
point of the nullclines, moves to the right branch of the cubic V-nullcline and becomes 
stable. The limit cycle shrinks and the spiking activity disappears, typically but not 
necessarily via the supercritical Andronov-Hopf bifurcation. Thus, the [y,,,)+/«-model 
with low-threshold Kt current can exhibit two such bifurcations in response to ramping 
up of the injected current, one leading to the appearance of periodic spiking activity 
(Fig.4.34), and then one leading to its disappearance (Fig.4.37). 


Supercritical and subcritical Andronov-Hopf bifurcations in neurons result in slightly 
different neurocomputational properties. In contrast, the saddle-node and Andronoy- 
Hopf bifurcations result in dramatically different neurocomputational properties. In 
particular, neurons near a saddle-node bifurcation act as integrators — they prefer 
high-frequency input. The higher the frequency of the input, the sooner they fire. 
In contrast, neural systems near Andronov-Hopf bifurcations have damped oscillatory 
potentials and act as resonators — they prefer oscillatory input with the same frequency 
as that of damped oscillations. Increasing the frequency may delay or even terminate 
their response. We discuss this and other neurocomputational properties in chapter 7. 
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Figure 4.37: Excitation block in the ya,+J/«-model. As the magnitude of the injected 
current J ramps up, the spiking stops. 
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Review of Important Concepts 


e A two-dimensional system of differential equations 


i(z,y) 
G(X, Y) ; 


describes joint evolution of state variables x and y, which often are the mem- 
brane voltage and a “recovery” variable. 


Solutions of the system are trajectories on the phase plane R? that are tangent 
to the vector field (f, g). 


The sets given by the equations f(z,y) = 0 and g(x,y) = 0 are the x- and 
y-nullclines, respectively, where trajectories change their x and y directions. 


Intersections of the nullclines are equilibria of the system. 
Periodic dynamics correspond to closed loop trajectories. 


Some special trajectories (e.g., separatrices) define thresholds and separate 
attraction domains. 


An equilibrium or a periodic trajectory is stable if all nearby trajectories are 
attracted to it. 


To determine the stability of an equilibrium, one needs to consider the Jacobian 
matrix of partial derivatives 
be(E &). 
Ge Gy 


The equilibrium is stable when both eigenvalues of L are negative or have 
negative real parts. 


The equilibrium is a saddle, a node, or a focus when L has real eigenvalues 
of opposite signs, of the same signs, or complex-conjugate eigenvalues, respec- 
tively. 


When the equilibrium undergoes a saddle-node bifurcation, one of the eigen- 
values becomes zero. 


When the equilibrium undergoes an Andronoy-Hopf bifurcation (birth or death 
of a small periodic trajectory), the complex-conjugate eigenvalues become 
purely imaginary. 


The saddle-node and Andronoy-Hopf bifurcations are ubiquitous in neural 
models, and they result in different neurocomputational properties. 
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Bibliographical Notes 


Among many textbooks on the mathematical theory of dynamical systems we recom- 
mend the following three. 


e Nonlinear Dynamics and Chaos by Strogatz (1994) is suitable as an introduc- 
tory book for undergraduate math or physics majors or graduate students in life 
sciences. It contains many exercises and worked-out examples. 


e Differential Equations and Dynamical Systems by Perko (1996, 3rd ed., 2000) is 
suitable for math and physics graduate students, but may be too technical for 
life scientists. Nevertheless, it should be a standard textbook for computational 
neuroscientists. 


e Elements of Applied Bifurcation Theory by Kuznetsov (1995, 3rd ed., 2004) is 
suitable for advanced graduate students in mathematics or physics and for compu- 
tational neuroscientists who want to pursue bifurcation analysis of neural models. 


The second edition of The Geometry of Biological Time by Winfree (2001) is a good 
introduction to oscillations, limit cycles, and synchronization in biology. It requires lit- 
tle background in mathematics and can be suitable even for undergraduate life science 
majors. Mathematical Biology by Murray (2nd ed., corr., 1993, 3rd ed., 2003) is an 
excellent example of how dynamical system theory can solve many problems in popu- 
lation biology and shed light on pattern formation in biological systems. Most of this 
book is suitable for advanced undergraduate or graduate students in mathematics and 
physics. Mathematical Physiology by Keener and Sneyd (1998) is similar to Murray’s 
book, but is more focused on neural systems. Spikes, Decisions, and Actions by H. R. 
Wilson (1999) is a short introduction to dynamical systems with many neuroscience 
examples. 


Exercises 


1. Use a pencil (as in Fig.4.39) to sketch the nullclines of the vector fields depicted 
in figures 4.40 through 4.44. 


2. Assume that the continuous curve is the x-nullcline and the dashed curve is the 
y-nullcline in Fig.4.38, and that « or y changes sign when (x,y) passes through 
the corresponding nullcline. The arrow indicates the direction of the vector field 
in one region. Determine the approximate directions of the vector field in the 
other regions of the phase plane. 


3. Use a pencil (as in Fig.4.39) to sketch phase portraits of the vector fields depicted 
in figures 4.40 through 4.44. Clearly mark all equilibria, their stability, and their 
attraction domains. Show directions of all homoclinic, heteroclinic, and periodic 
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Figure 4.38: Determine the approximate direction of the vector field in each region 
between the nullclines. Continuous (dashed) curve is the z-nullcline (y-nullcline), and 
the direction of the vector field in one region is indicated by the arrow. 


trajectories, as well as other representative trajectories. Estimate the signs of 
eigenvalues at each equilibrium. 


4. Prove the classification diagram in Fig.4.15. 


5. (van der Pol oscillator) Determine nullclines and draw the phase portrait of the 
van der Pol oscillator given in the Liénard (1928) form 


= r—2°/3-y, 
ae 


where b > 0 is a parameter. 


6. (Bonhoeffer—van der Pol oscillator) Determine the nullclines and sketch represen- 
tative phase portraits of the Bonhoeffer—van der Pol oscillator 


= 2-2°/3-y, 
y _ b(x _ a) — cy , 
in the case of c= 0. Treat a and b > 0 as parameters. 


7. (Hindmarsh-Rose spiking neuron) The following system is a generalization of the 
FitzHugh-Nagumo model (Hindmarsh and Rose 1982): 


f= fej-yrt 
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Figure 4.39: Phase portrait of a vector field. Use pencil to draw phase portraits in 


figures 4.40 through 4.44. 
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Figure 4.40: Use a pencil to draw a phase portrait, as in Fig.4.39. 
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Figure 4.43: Use a pencil to draw a phase portrait, as in Fig.4.39. 
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Figure 4.44: Use a pencil to draw a phase portrait, as in Fig.4.39. 


where f(x) = —ax? + bx”, g(x) = —c+ dz’, and a,b,c,d, and I are parameters. 
Suppose (Z, y) is an equilibrium. Determine its type and stability as a function 
of f’ = f(z) and g’ = g(Z); that is, plot a diagram similar to the one in Fig.4.15, 
with f’ and g’ as coordinates. 


. (Ix-model) Show that the unique equilibrium in the [x-model 


CV = -g(V — E,) —gxm*(V — Ex), (4.14) 
m = (m(V) —m)/r(V). (4.15) 


discussed in chapter 3 (see Fig.3.40), is always stable, at least when Ey, > Ex. 
(Hint: Look at the signs of the trace and the determinant of the Jacobian matrix). 


. (Iy-model) Show that the unique equilibrium in the full J,-model 


OV 
h 


=GiV = fn) =GahlV = fa) 3 
(ho(V) —h)/r(V) , 


discussed in chapter 3 is always stable. 


(Bendixson’s criterion) If the divergence of the vector field 


Of(t,y) , O9(%,y) 
Ox Oy 
of a two-dimensional dynamical system is not identically zero, and does not 


change sign on the plane, then the dynamical system cannot have limit cycles. 
Use this criterion to show that the Jx-model and the /,-model cannot oscillate. 


Determine the stability of equilibria in the model 


z= at+n2’-y, 


yY = br=—cy, 


where a € R, b> 0, and c > 0 are some parameters. 


Chapter 5 


Conductance-Based Models and 
Their Reductions 


In this chapter we present examples of geometrical phase plane analysis of various 
two-dimensional neural models. In particular, we consider minimal models, i.e., those 
having minimal sets of currents that enable the models to generate action potentials. 
The remarkable fact is that all these models can be reduced to planar systems having 
N-shaped V-nullclines. We will see that the behavior of the models depends not so 
much on the ionic currents as on the relationship between (in)activation curves and the 
time constants. That is, models involving completely different currents can have iden- 
tical dynamics and, conversely, models involving similar currents can have completely 
different dynamics. 


5.1 Minimal Models 


There are a few dozen known voltage- and Ca?*-gated currents having diverse activa- 
tion and inactivation dynamics, and this number grows every year. Some of them are 
summarized in section 2.3.5. Almost any combination of the currents would result in 
interesting nonlinear behavior, such as excitability. Therefore, there are billions (more 
than 2°°) of different electrophysiological models of neurons. Here we say that two 
models are “different” if, for example, one has the h-current J, and the other does not, 
without even considering how much of the J, there is. How can we classify all such 
models? 

Let us do the following thought experiment. Consider a conductance-based model 
capable of exhibiting periodic spiking, that is, having a limit cycle attractor. Let us 
completely remove a current or one of its gating variables, then ask the question “Does 
the reduced model have a limit cycle attractor, at least for some values of parameters?” 
If it does, we remove one more gating variable or current, and proceed until we arrive 
at a model that satisfies the following two properties: 


e It has a limit cycle attractor, at least for some values of parameters. 
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e If one removes any current or gating variable, the model has only equilibrium 
attractors for any values of parameters. 


We refer to such a model as being minimal or irreducible for spiking. Thus, minimal 
models can exhibit periodic activity, even if it is of small amplitude, but their reductions 
cannot. According to this definition, any space-clamped conductance-based model 
of a neuron either is a minimal model or could be reduced to a minimal model or 
models by removing gating variables. This will be the basis for our classification of 
electrophysiological mechanisms in neurons. 

For example, the Hodgkin-Huxley model considered in section 2.3 is not minimal 
for spiking. Recall that the model consists of three currents: leakage [,,, transient 
sodium Jy, (gating variables m and h), and persistent potassium J (gating variable 
n); see Fig.5.1. Which of these currents are responsible for excitability and spiking? 

We can remove the leakage current and the gating variable, h, for the inactivation 
of the sodium current: The resulting [Nap+Jk-model 


Tk Legace 
: aN ——— 
CV = I — gxn*(V — Ex) — gnam?(V — Ena) , 


(Noo(V) — n)/TalV) ; 
(Moo(V) — m)/Tm(V) 5 


ies 
I| 


Remove h 
and Leak 


Minimal Models 


h m n 
Gating for Gating for Gating for 
Inactivation Activation Activation 


of Na Current of Na Current of K Current 
Peak Gurren Gating variables 


Figure 5.1: The Hodgkin-Huxley model (top box) is a combination of minimal models 
(shaded boxes on second level). Each minimal model can oscillate for at least some 
values of its parameters. 
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was considered in the previous chapter where we have shown that it could oscillate due 
to the interplay between the activation of persistent sodium and potassium currents. 
Alternatively, we can remove the K* current from the Hodgkin-Huxley model, yet the 
new Jy,,t-model 


Ina,t tT 
: a iN 
C V=aTf- gnam®h(V = Ena) = gi(V = Ex) ; 


(Moo(V) — m)/Tm(V) ; 
ho = (Roo(V) — h)/TH(V) 5 


3 
T 


can still oscillate via the interplay between activation and inactivation of the Nat 
current, as we will see later in this chapter. Both models are minimal, because removal 
of any other gating variable results in the INap-, [«-, or y-models, none of which can 
have a limit cycle attractor, as the reader is asked to prove at the end of chapter 4. 

We see that the Hodgkin-Huxley model is not minimal by itself, but is a combination 
of two minimal models. Minimal models are appealing because they are relatively 
simple; each individual variable has an established electrophysiological meaning, and its 
role in dynamics can be easily identified. As we show below, many minimal models can 
be reduced to planar systems, which are amenable to analysis using geometrical phase 
plane methods. In section 5.2 we discuss other methods of reducing multidimensional 
models, e.g., the Hodgkin-Huxley model, to planar systems. 

There are only few minimal models, and understanding their dynamics can shed 
light on dynamics of more complicated electrophysiological models. However, the 
reader should be aware of the limitations of such an approach: Understanding minimal 
models cannot provide exhaustive information about all electrophysiological models 
(just as understanding the zeros of the equations y = x and y = x? does not provide 
complete information about the zeros of the equation y = x + 27). 


5.1.1 Amplifying and Resonant Gating Variables 


The definition of the minimal models involves a top-down approach: take a complicated 
model and strip it down to minimal ones. It is unlikely that this could be done for all 
2°° or so electrophysiological models. Instead, we employ here a bottom-up approach, 
which is based on the following rule of thumb: a mixture of one amplifying and one 
resonant (recovery) gating variable (plus an Ohmic leak current) results in a minimal 
model. Indeed, neither of the variables alone can produce oscillation, but together they 
can (as we will see below). 

The amplifying gating variable is the activation variable m for voltage-gated in- 
ward current or the inactivation variable h for voltage-gated outward current, as in 
Fig.5.2. These variables amplify voltage changes via a positive feedback loop. Indeed, 
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= potential | potential on whether they represent activa- 
g Ag as tion/inactivation of inward/outward 
currents (see also Fig.3.3 and 3.4). 


a small depolarization increases m and decreases h, which in turn increases inward 
and decreases outward currents and increases depolarization. Similarly, a small hyper- 
polarization decreases m and increases h, resulting in less inward and more outward 
current, and hence in more hyperpolarization. 

The resonant gating variable is the inactivation variable h for an inward current or 
the activation variable n for an outward current. These variables resist voltage changes 
via a negative feedback loop. A small depolarization decreases h and increases n, which 
in turn decreases inward and increases outward currents and produces a net outward 
current that resists the depolarization. Similarly, a small hyperpolarization produces 
inward current and, possibly, rebound depolarization. 

Currents with amplifying gating variables can result in bistability, and they behave 
essentially like the [Nap-model or [i;-model considered in chapter 3. Currents with 
resonant gating variables have one stable equilibrium with possibly damped oscillation, 
and they behave essentially like the [x-model or the /,-model (compare Fig.5.2 with 
Fig.3.3). A typical neuronal model consists of at least one amplifying and at least one 
resonant gating variable. (Amplifying and resonant gating variables for Ca?*-sensitive 
currents are discussed later in this chapter). 

To get spikes in a minimal model, we need a fast positive feedback and a slower 
negative feedback. Indeed, if an amplifying gating variable has a slow time constant, 
it would act more as a low-pass filter, hardly affecting fast fluctuations and amplifying 
only slow fluctuations. If a resonant gating variable has a fast time constant, it will 
act to damp input fluctuations (faster than they can be amplified by the amplifying 
variable), resulting in stability of the resting state. Instead, the resonant variable 
acts as a band-pass filter; it has no effect on oscillations with a period much smaller 
than its time constant; it damps oscillations having a period much larger than its 
time constant, because the variable oscillates in phase with the voltage fluctuations; it 
amplifies oscillations with a period that is about the same as its time constant because 
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the variable lags the voltage fluctuations. 


Since the amplifying gating variable, say m, has relatively fast kinetics, it can be 
replaced by its equilibrium (steady-state) value m(V). This allows us to reduce the 
dimension of the minimal models from 3 (say V, m, n) to 2 (V and n). 


Two amplifying and two resonant gating variables produce four different combina- 
tions, depicted in Fig.5.3. However, the number of minimal models is not four, but six. 
The additional models arise due to the fact that a pair of gating variables may describe 
activation/inactivation properties of the same current or of two different currents. For 
example, the activation and inactivation gating variables m and h may describe the 
dynamics of a transient inward current, such as Iy,, or the dynamics of a combination 
of one persistent inward current, such as Iya», and one “hyperpolarization-activated” 
inward current, such as J). Hence this pair results in two models, [Nat and [Na py+dh. 
Similarly, the pair of activation and inactivation variables of an outward current may 
describe the dynamics of the same transient current, such as [,, or the dynamics of 
two different outward currents; hence the two models, J, and Iki;+Jk. 


Below we present the geometrical analysis of the six minimal voltage-gated models 
shown in Fig.5.3. Though they are based on different ionic currents, the models have 
many similarities from the dynamical systems point of view. In particular, all can 
exhibit saddle-node and Andronov-Hopf bifurcations. For each model we first provide a 
word description of the mechanism of generation of sustained oscillations, and then use 
phase plane analysis to provide a geometrical description. The first two, the [Na »+Ik- 
model and the Jna4-model, are common; they describe the mechanism of generation of 
action potentials or subthreshold oscillations by many cells. The other four models are 
rare; they might even be classified as weird or bizarre by biologists, since they reveal 
rather unexpected mechanisms for voltage oscillations. Nevertheless, it is educational 
to consider all six models to see how the theory of dynamical systems works where 
intuition and common sense fail. 


Conductance-Based Models 


132 
1 1 
I=0 
Es 
0.8 s 0.8 
c 0 6 If c 
¢ i ¢ 
506 506 
E s 
6 8 
S04 +04 
< < 
4 
2 
0.2 % 0.2 
@ 


-60 -20 0 20 
membrane voltage, V 
1 1 ze 
|=40 a 
j 0 15 
Cc = 
5 506 i 
= é Co; 
i © o4 3; 
+ one ai Z 
Na x cg, Sy 
i ZS 
S. 
0.2 a 
0 fees 
-60 -20 0 20 -60 -20 0 20 
membrane voltage, V membrane voltage, V 
a b 


Figure 5.4: Possible forms of nullclines in the [y,»+J«-model (parameters as in 
Fig.4.1). 


5.1.2 INap+lk-Model 
One of the most fundamental models in computational neuroscience is the INaptlk- 
model (pronounced persistent sodium plus potassium model), which consists of a fast 
Na* current and a relatively slower K* current: 
leak J, INap Ix 
: —_“— -eQOQOroOoOorOooern*  ————————r 
CV = I- gi(V —Ez) = gnam(V = Ena) = gxn(V = Ex) 5 
m (Mo(V) — m)/Tm(V) , 
= (No(V) — n)/Tr(V) - 


This model is in many respects equivalent to the Jc,+J/,%-model proposed by Morris 
and Lecar (1981) to describe voltage oscillations in the barnacle giant muscle fiber. 
A reasonable assumption based on experimental observations is that the Nat gating 
variable m(t) is much faster than the voltage variable V(t), so that m approaches the 
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asymptotic value m.(V) practically instantaneously. In this case we can substitute 
M = M.~(V) into the voltage equation and reduce the three-dimensional system above 
to a planar system, 


leak Ty, instantaneous INa,p Ik 
: ————SS_L__——OCOCrC eee OS 
CV = I — gL(V—E,z) — gnamMx(V) (V —Ena) — 9x n (V — Ex) (5.1) 


which was considered in detail in chapter 4. In Fig.5.4 we summarize the dynamic 
repertoire of the model. A striking observation is that the other minimal models can 
have similar nullclines and similar dynamic repertoire, even though they consist of 
quite different ionic currents. 


5.1.3 [Na t-model 


An interesting example of a spiking mechanism, implicitly present in practically every 
biological neuron, is given by the Jya4-model (pronounced transient sodium model), 


. leak I, INa,t 

CV = I — g(V—E,) — gnam@h(V — Ena) , 
mM = (Moo(V)—m)/Tm(V) 5 
h = (heo(V) —h)/tr(V) , 


consisting only of an Ohmic leak current and a transient voltage-gated inward Nat 
current. How could such a model generate action potentials? The upstroke of an 
action potential is generated because of the regenerative process involving the acti- 
vation gate m. This mechanism is similar to that in the Hodgkin-Huxley model and 
the [Nap+Jxk-model: increase of m results in an increase of the inward current; hence 
more depolarization and further increase of m until the excited state is achieved. At 
the excited state there is a balance of the Nat inward current and the leak outward 
current. 

Since there is no Jk, the downstroke from the excited state occurs via a different 
mechanism. While in the excited state, the Na* current inactivates (turns off) and the 
Ohmic leak current slowly repolarizes the membrane potential toward the leak reverse 
potential EL, which determines the resting state. While at rest, the Nat current 
deinactivates (i.e., becomes available), and the neuron is ready to generate another 
action potential. This mechanism is summarized in Fig.5.5. 

To study the dynamics of the Jy,,-model, we first reduce it to a planar system. 
Assuming that activation dynamics is instantaneous, we use m = m,.(V) in the voltage 
equation and obtain 


leak Ti, Iva,t, st. activation 


CV = I — gi(V— FE.) — gnams(V)A(V — Ena) , 
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h = (Roo(V) — h)/ta(V) . 


One can easily find the nullclines 


I = gL(V —E,) 7 
h= V-nullcline 
gam, (VV — Ena) | ) 


and 
b= ligtV) (h-nullcline) . 


The V-nullcline looks like a cubic parabola (flipped N-shape), and the h-nullcline has 
a sigmoid shape. In Fig.5.6 we depict two typical cases (we invert the h-axis so that 
the vector field is directed counterclockwise, and this phase portrait is consistent with 
the other phase portraits in this book). 

When the inactivation curve h..(V) has a high threshold (i.e., [Nat is a window 
current), there are three intersections of the nullclines, and hence three equilibria, 
as in Fig.5.6a. A stable node (filled circle) corresponds to the resting state, and a 
nearby saddle corresponds to the threshold state. Another equilibrium, an unstable 
focus denoted by a white circle at the top of the figure, determines the shape of the 
action potential since all “spiking” trajectories have to go around it. Because of the 
high threshold of inactivation, the Jy, current is deinactivated at rest. Moreover, 
small fluctuations of V do not produce significant changes of the inactivation variable 
h because the h-nullcline is nearly horizontal at rest. Such a system does not perform 
damped oscillations, and the nonlinear dynamics of the V near resting state can be 
described by the one-dimensional system (where h = h(V)) 


CV=I- giL(V — Ey) - gnams.(V)hoo(V)(V — Ena) 


studied in chapter 3. When J increases, the stable node and the saddle approach, 
coalesce, and annihilate each other via saddle-node bifurcation. When J = 0.5, there is 
a periodic trajectory with a long period (compare the time scales in the bottom insets 
in Fig.5.6a and 5.6b). 

When the Na* inactivation curve h,.(V) has a low threshold, the nullclines have 
only one intersection; hence there is only one equilibrium, as in Fig.5.6b. When J = 
0, the equilibrium (filled circle) is stable, and all trajectories converge to it. There 
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Figure 5.6: Possible forms of nullclines in the [y,4-model. Notice that the h-axis 
is inverted. Parameters for Jy, are as in the Hodgkin-Huxley model, except that 
m(V) = 5 ms. Ey, = 60 mV, Ey = —70 mV, gt = 1, gna = 15 (in b) and gna = 10 
and Vj/2 = —42 mV (in a). 


are damped oscillations near the equilibrium, though they can hardly be seen in the 
figure. The oscillations occur because the Ja, Current is partially inactivated at rest. 
An increase of V leads to more inactivation, less inward current, and hence rebound 
decrease of V, which in turn leads to partial deinactivation, more inward current, and 
to rebound increase of V. When the applied DC current J increases, the equilibrium 
loses stability via Andronov-Hopf bifurcation. When J = 4, the equilibrium is an 
unstable focus (white circle in the figure), and there is a stable limit cycle attractor 
around it corresponding to periodic spiking. 


We see that the Jy,,,-model exhibits essentially the same dynamic repertoire as the 
INa,pt+Ix-model, even though the models are quite different from the electrophysiolog- 
ical point of view. 
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model. 


5.1.4 Ina p+lp-Model 


The system (pronounced persistent sodium plus h-current model) 


| leak Jy, Naas Th 
CV = I-g.(V—E,) —gnam(V — Ena) — gnh(V — Fr) , 
(Mao(V) —m)/Tm(V) , 
(Ro(V) — h)/(V) , 


=F 
I 


>: 
I 


is believed to describe the essence of the mechanism of slow subthreshold voltage os- 
cillations in some cortical, thalamic, and hippocampal neurons, which we summarize 
in Fig.5.7. Like any other minimal model in this section, it consists of one amplifying 
(Ina,p) and one resonant (J,;) current. Both currents may be partially active at rest- 
ing voltage. Recall that we treat the h-current as an inward current that is always 
activated (its activation variable m = 1 all the time), but can be inactivated (turned 
off) by depolarization and deinactivated (turned on) by hyperpolarization. At resting 
voltage this current is usually inactivated (turned off). A sufficient hyperpolarization 
of V deinactivates (turns on) the h-current, resulting in rebound depolarization. While 
depolarized, the h-current inactivates (turns off), and the leak current repolarizes the 
membrane potential toward the resting state. Without the persistent Na* current, 
or some other amplifying current, these oscillations always subside, as the reader was 
asked to prove in chapter 4, exercise 10. However, they may become sustained when 
INa,p is involved. 

To study dynamics of the INa»+Jp-model, we assume that the activation kinetics 
of the Na* current is instantaneous, and use m = m(V) in the voltage equation to 
obtain a two-dimensional system 


leak Ty, instantaneous INa,p Th 
‘ 7 ti tt et 
C V=aTf- gi(V —E,) = GNaMo(V)(V = Ena) = gnh(V = En) 7 


h = (Roo(V) — h)/T(V) - 
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Figure 5.8: Rest and sustained subthreshold oscillations in the [Nap»+Jp-model. Pa- 
rameters for currents are as in thalamocortical neurons, Ey, = 20 mV, Ey, = —43 mV, 
A, = =80 mV, or = 1.3, gn, = 0.9, and g, = 4. 


The nullclines of this system, 


_ 1 = 9(V—Et) = graMoo(V)(V — Ena) 
gu(V — Ey) 


h (V-nullcline) 


and 
R= het) (h-nullcline), 


have the familiar N- and sigmoid shapes depicted in Fig.5.8. We take the parame- 
ters for both currents from the experimental studies of thalamic relay neurons (see 
section 2.3.5). This choice results in one intersection of the nullclines in the relevant 
voltage range, which corresponds to only one equilibrium. This equilibrium is a stable 
resting state when no current is injected, i.e., when J = 0. In Fig.5.8 (top), one can 
clearly see that h ~ 0; that is, the h-current is inactivated (turned off). The resting 
state is due to the balance of the inward persistent Na* current and the Ohmic leak 
current. A small hyperpolarization deactivates the fast Nat current and shifts the 
balance toward the leak current, which brings V closer to Fieax. This, in turn, results 
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in slow deinactivation (turning on) of the h-current, which produces a strong inward 
current and brings the membrane voltage back to the resting state. 

Negative injected current (case J = —1 in Fig.5.8) destroys the balance of inward 
(nap) and outward (Jicak) currents at rest, and makes the resting state unstable. As 
a result, the model exhibits sustained subthreshold oscillations of membrane poten- 
tial. Indeed, prolonged hyperpolarization turns on a strong h-current and produces 
prolonged depolarization. Such a depolarization turns off the h-current, and the neg- 
ative injected current hyperpolarizes the membrane potential again. As a result, the 
model exhibits sustained oscillations in the voltage range of —55 mV to —65 mV. The 
frequency of such oscillations depends on the parameters of the voltage equation and 
the time constant 7(V) of the h-current; it is near 4 Hz in Fig.5.8. 


5.1.5 In tlky-Model 


The persistent Nat current, which amplifies the damped oscillations in the INaptJh- 
model, can be replaced by the K* inwardly rectifying current Ij, to achieve the same 
amplifying effect. The resulting [,+J«i:-model (pronounced h-current plus inwardly 
rectifying potassium model) 


leak Jy, ee ty 
‘ —_—"—_ =A". ON 
CV = I- oL(V —E,) — OKirKir(V _ Ex) = guh(V _ Ey) , 


his = (lignes (V) lie) tee V) 5 
h = (ho(V) —h)/t(V) , 


can exhibit sustained subthreshold oscillations of membrane voltage via a rather weird 
mechanism illustrated in Fig.5.9. The inwardly rectifying K* current Ij, behaves like 
In, except that the former is an outward current. A brief hyperpolarization deinac- 
tivates (turns on) the fast outward current Ji, and produces more hyperpolarization 
via a positive feedback loop. Such a regenerative process results in a prolonged hyper- 
polarization that deinactivates (turns on) the slower inward current f, and produces 
a rebound depolarization. This depolarization is enhanced by inactivation (turning 
off) of the fast Iki. However, the membrane potential cannot hold long in the depo- 
larized state because of the slow depolarization-triggered decrease of J,, and the leak 
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Figure 5.10: Resting and sustained subthreshold oscillations in the [,+Ji-model. 
Parameters: Ex = —80 mV, & = —48 mV, Ay = —50 mV, gx = 4, gn = 0.5, 
g. = 0.44. The h-current is the same as in section 5.1.4, except Vis2 = —65 mV. 
Instantaneous [jr has Viz = —76 mV and k = —11. 


current repolarizes the membrane potential. The repolarization is enhanced by the 
deinactivation of Ij, and becomes a hyperpolarization again, leading to the oscilla- 
tions summarized in Fig.5.9. 

Since the kinetics of [xi, is practically instantaneous, one can use hxir = AKiro(V) 
in the voltage equation above and consider the two-dimensional system 


leak Jy, instantaneous Iii; Th 
5 NN See 
CV = I- gu(V — Ez) — OKir hKir,oo(V )(V = Ex) = Inh(V a En) ) 


hh = (hoo(V) —h)/7(V). 


One can easily find the nullclines of this system, 


I — gi (V —Ex) — gxirhkir,oo(V)(V — Ex) 
= V-nullcline 
gn(V — Ey) ( ) 


and 
k= hel V) (h-nullcline), 


which have the familiar form depicted in Fig.5.10. Most values of the parameters 
result in a phase portrait similar to the one depicted in Fig.5.10 (left). The V-nullcline 
is a monotonic curve that intersects the h-nullcline in one point corresponding to a 
stable resting state. An injected DC current J shifts the resting state, but does not 
change its stability: Voltage perturbations always subside, resulting only in damped 
oscillations. There is, however, a narrow region in parameter space (it took the author 
a few hours to find that region) that produces just the right relationship between 
inactivation curves and conductances so that the V-nullcline becomes N-shaped and 
the subthreshold oscillations become sustained, as in Fig.5.10 (right). 
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5.1.6 Ik t]kn-Model 


The last two minimal models consist exclusively of outward K* currents, yet they can 
exhibit sustained oscillations of membrane voltage. The models defy the imagination 
of many biologists: How can a neuron with only outward Kt currents and no inward 
Nat or Ca?* currents fire action potentials? 

In the Jx+Jxir-model (pronounced persistent plus inwardly rectifying potassium 
model) 


Tir Ix 
, iT aN 
ft = (Meo(V) —n)/ra(V) 


ho = (Reo(V) — h)/talV) | 


the amplifying current is Jxi; with inactivation gating variable h, and the resonant 
current is Ix with activation variable n. The mechanism of generation of action poten- 
tials is summarized in Fig.5.11. A strong injected current depolarizes the membrane 
potential and inactivates (turns off) [q;,, which amplifies the depolarization. While 
depolarized, the slower Kt current [x activates and brings the potential down with 
possible hyperpolarization, which is amplified by the deinactivation of [x;,. While the 
membrane potential is hyperpolarized, [x deactivates and the strong injected current 
brings the potential up again. Thus, the upstroke of the action potential is due ex- 
clusively to the injected DC current J, while the downstroke is due to the persistent 
outward K* current. 

To perform the geometrical phase plane analysis of the model, we take advantage of 
the same observation as before: the kinetics of the amplifying current [Ki, is relatively 
fast, so that h = h(V) can be used in the voltage equation to reduce the three- 
dimensional system above to the two-dimensional system 


instantaneous Ikiz Tk 
. eS Oo” On 
C V= [- GKirNoo(V) (V = Ex) = gxn(V = Ex) 5 


= (No(V) — )/THV) . 
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Figure 5.12: Possible intersections of nullclines in the Ix+Jkir-model. Parameters: 


Ex = —80 mV, gxir = 20, gk = 2. Instantaneous Ixy with Vij. = —80 mV and 
k = —12. Slower Ix with k = 5, 7(V) = 5 ms, and Viz = —40 mV (in a) or 
Viz = —55 mV (in b). 


It is an easy exercise to find the nullclines 


n=I1/{gx(V — Ex)} — gxirho(V)/gx (V-nullcline) 


and 


n= V) (n-nullcline) , 


which we depict in Fig.5.12. There are two interesting cases corresponding to high- 
threshold (Fig.5.12a) and low-threshold (Fig.5.12b) K* current Ix. 

When the Jx has a low threshold, it is partially activated at resting potential. In 
this case, the resting state corresponds to the balance of partially activated Ix, par- 
tially inactivated [ki,, and a strong injected DC current J. (Without the DC current 
the membrane voltage would converge to Ex = —80 mV and stay there forever.) A 
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small depolarization partially inactivates fast Ij, but leaves the slower J, relatively 
unchanged. This results in an imbalance of the inward DC current J and all out- 
ward currents, and the net inward current further depolarizes the membrane voltage. 
Depending on the size of the depolarization, the model may generate a subthreshold re- 
sponse or an action potential, as one can see in Fig.5.12b (top). During the generation 
of the action potential, the persistent Kt current activates and causes afterhyperpo- 
larization. During the afterhyperpolarization, the persistent Kt current deactivates 
below the resting level. This lets the injected DC current J depolarize the membrane 
potential again, provided that J is strong enough, as in Fig.5.12b (bottom). 

In Fig.5.12a we leave all parameters unchanged except that we increase the half- 
voltage activation Vj /2 of Ik by 15 mV, and decrease J to compensate for the deficit 
of outward current. Now, the resting state corresponds to the balance of Jxi, and 
I, because the high-threshold persistent K* current is completely deactivated in this 
voltage range. The behavior near the resting state is determined by the interplay 
between instantaneous [,;, and J, and it was studied in chapter 3 (see exercises, [Ki:- 
model). There are two equilibria: a stable node corresponding to the resting state 
and a saddle corresponding to the threshold state. A sufficiently strong perturbation 
can push V beyond the saddle equilibrium, as in Fig.5.12a (top), and can cause the 
minimal model to fire an action potential. If we increase J, the node and the saddle 
approach, coalesce, and annihilate each other via a saddle-node bifurcation, and the 
model starts to fire action potentials periodically. 

We see that [kK +JKi-model has essentially the same dynamic repertoire as the more 
conventional INap»+/x-model or the Iya y-model, despite the fact that it is based on a 
rather bizarre ionic mechanism for excitability and spiking. 


5.1.7 I,-Model 


The last minimal voltage-gated model has only one transient K* current, often referred 
to as the A-current J,, yet it can also generate sustained oscillations. In some sense, the 
model is similar to the [ya-model. Indeed, each consists of only one transient current 
and an Ohmic leak current. The only difference is that the A-current is outward, and 
as a result the action potentials are fired downward; see Fig.5.14 and Fig.5.15. 

The A-current has activation and inactivation variables m and h, respectively, and 
the I,-model (pronounced transient potassium model or A-current model) has the form 


leak Jy, In 
* —— TT 
C V=aTf- gL(V = Ey) — gamh(V = Ex) 


m = (Moo(V) —m)/Tm(V) 
h (hoo(V) — h)/ta(V) - 


The mechanism of generation of downward action potentials is summarized in Fig.5.13. 
Due to a strong injected DC current, the resting state is in the depolarizing voltage 
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range, and it corresponds to the balance of the partially activated, partially inactivated 
A-current, the leak outward current, and the injected DC current. A small hyperpolar- 
ization can simultaneously deactivate and deinactivate the A-current, that is, decrease 
variable m and increase variable h. Depending on the relationship between the acti- 
vation and inactivation time constants, this may result in an increase of the A-current 
conductance, which is proportional to the product mh. More outward current produces 
more hyperpolarization and even more outward current. As a result of this regenerative 
process, the membrane voltage produces a sudden downstroke. While hyperpolarized, 
the A-current deactivates (variable m — 0), and the injected DC current slowly brings 
the membrane potential toward the resting state, resulting in a slow upstroke. A fast 
downstroke and a slower upstroke from a depolarized resting state look like an action 
potential pointing downward. 


If activation kinetics is much faster than inactivation kinetics, we can substitute 
m = m,(V) into the voltage equation above and reduce the [,-model to a two- 
dimensional system, which hopefully would have the right kind of nullclines and a 
limit cycle attractor. After all, this is what we have done with previous minimal 
models, and it has always worked. As the reader is asked to prove in exercise 1, the 
I,-model cannot have a limit cycle attractor when the A-current activation kinetics 
is instantaneous. Oscillations are possible only when the activation and inactivation 
kinetics have comparable time constants or inactivation is much faster than activation. 


Even though none of the experimentally measured A-currents show fast inactivation 
and a relatively slower activation, this case is still interesting from the pure theoretical 
point of view, since it shows how a single K* current can give rise to oscillations. 
Assuming instantaneous inactivation and using h = h..(V) in the voltage equation, we 
obtain a two-dimensional system, 


leak Jy, Ia, inst. inactivation 
CV = I -— g(V—E,) — gamh(V)(V — Ex) , 


m = (Moo(V)—m)/Tm(V) ; 
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whose nullclines can easily be found: 


ie I = gi(V — Ez) 
© gahoo(V)(V — Ex) 


(V-nullcline) 


and 
m=mM~(V) (m-nullcline) . 


Two typical cases are depicted in Fig.5.14a and 5.14b. We start with the simpler case 
in Fig.5.14b. 

Figure 5.14b depicts nullclines when the A-current has a low activation threshold. 
There is only one intersection of the nullclines; hence there is only one equilibrium, 
which is a stable focus when the injected DC current J is not strong enough (Fig.5.14b, 
top). Increasing J makes the equilibrium lose stability via a supercritical Andronov- 
Hopf bifurcation that gives birth to a small amplitude limit cycle attractor (not shown 
in the figure). A further increase of I increases the amplitude of oscillations (e.g., when 
I = 10 in the middle of Fig.5.14b), and the attractor corresponds to periodic firing of ac- 
tion potentials. When J = 10.5, the attractor disappears and the equilibrium becomes 
stable (via Andronov-Hopf bifurcation) again. The model, however, becomes excitable. 
A small hyperpolarization does not significantly change the A-current, and the voltage 
returns to resting state, resulting in a “subthreshold response”. A sufficiently large 
hyperpolarization deinactivates enough J, to open the Kt current and hyperpolarize 
the membrane even further. This regenerative process produces the downstroke and 
brings V close to Ex. During the state of hyperpolarization, the A-current deactivates 
(m — 0), and the DC current J brings V back to resting state. Notice that the action 
potential is directed downward. 

In Fig.5.14a we consider the J,4-model with exactly the same parameters except 
that we shift the half-voltage activation Vj /2 of [, by 10 mV, so that the A-current has 
a higher activation threshold. This does not greatly affect the behavior of the system 
when IJ is small. However, when J & 10.7, the spiking limit cycle attractor undergoes 
another kind of bifurcation — saddle-node bifurcation — resulting in the appearance 
of two new equilibria: a stable node and a saddle. If the reader looks at Fig.5.14a 
upside-down, he or she will notice that this figure resembles figure 5.4a, 5.6a, or 5.12a, 
with all the consequences: the node corresponds to a resting state, and the saddle 
corresponds to the threshold state. The large-amplitude trajectory that starts at the 
saddle and terminates at the node corresponds to an action potential, though a weird 
one. Thus, the behavior of this model is similar to the behavior of other models, with 
the exception that the V-axis is reversed. 

The existence of “upside-down” K* spikes may (or, better say, does) look bizarre to 
many researchers, even though “inverted” Kt and Cl~ spikes were reported in many 
preparations, including frog and toad axons, squid axons, lobster muscle fibers, and 
dog cardiac muscle, as reviewed by Reuben et al. (1961) and Grundfest (1971). Two 
such cases are depicted in Fig.5.15. Interestingly, Reuben et al. (1961) postulated, 
albeit reluctantly, that the inverted spikes are caused by the inactivation of the K* 
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Figure 5.14: Possible intersections of nullclines in the J4-model. Parameters: Ex = 
—80 mV, FE, = —60 mV, ga = 5, gp = 0.2. Instantaneous inactivation kinetics with 
Vi/2 = —66 mV and k = —10. Activation of the A-current with k = 10, 7(V) = 20 ms, 
and Vi/2 = —45 mV (in a) or Viz = —35 mV (in b). 


current. The reluctance was due to the fact that transient K* J, was not known at 


that time. 


By now the reader must be convinced that quite different models can have practi- 
cally identical dynamics. Conversely, the same model could have quite different behavy- 
ior if only one parameter, e.g., Vi/2, is changed by as little as 10 mV. Such dramatic 
conclusions emphasize the importance of geometrical phase plane analysis of neuronal 
models, since the conclusions can hardly be drawn from mere word descriptions of the 
spiking mechanisms. 
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from Fig.2 of Reuben et al. 1961) and in (b) jee esophageal cells ee from 
Fig.16 of del Castillo and Morales 1967; the cell is depolarized by injected DC current). 
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5.1.8 Ca2+-Gated Minimal Models 


So far, we have considered minimal models consisting of voltage-gated currents only. 
However, there are many ionic currents that depend not only on the membrane poten- 
tial but also on the concentration of intracellular ions, mostly Ca?*+. Such currents are 
referred to as Ca?+-gated, and they are summarized in Fig.5.16. In addition, there are 
Cl--gated, Kt-gated, and Nat-gated currents, such as the SLO gene family of Cl-- 
gated Kt currents discovered in C. elegans, and the related “slack and slick” family of 
Nat-gated Kt currents (Yuan et al. 2000, 2003). Considering minimal models involv- 
ing these currents lies outside the scope of this book, but it could be a good intellectual 
exercise for an expert reader (see also exercise 7 and 8). 

Ca?t-gated currents can also be divided into amplifying and resonant currents. 
Ca?t-activated inward currents, such as the cation nonselective Joan, act as amplifying 
currents. Indeed, activation of such a current leads to an influx of Ca?* ions and to more 
activation. Similarly, a hypothetical outward current inactivated by Ca?*(not present 
in the figure) might also act as an amplifying current. Indeed, a depolarization due to 
the Ca?* influx inactivates such a hypothetical outward current, thereby producing a 
net shift toward inward currents and leading to more depolarization. 

In contrast, Ca?+-inactivating inward currents and Ca?+-activating outward cur- 
rents, such as Jcga(t) and Japp, respectively, act as resonant currents. Indeed, a de- 
polarization due to the Ca?* influx inactivates the inward current and activates the 
outward current, and resists further depolarization. 

Any combination of one voltage- or Ca?*-gated amplifying current and one voltage- 
or Ca?t-gated resonant current leads to a minimal model for spiking. All such com- 
binations are depicted in Fig.5.17. Here, J, denotes a hypothetical Ca?*t-activated 
voltage-inactivated transient inward current. Though such a current is not presently 
known, one can easily write a conductance-gated model for it. A biologist would treat 
such a current as hyperpolarization- and Ca?*-activated. Io is a hypothetical Ca?* cur- 
rent that is inactivated by Ca?*. Is is a hypothetical voltage-inactivated Ca?* current. 
I, is an outward Ca?*-inactivated current. 

We see that there are many minimal models in Fig.5.17. Six of them are purely 
voltage-gated, and they have been investigated above. The others are mixed-mode or 
purely Ca?+-gated models. An interested reader can work out the details of their phase 
portraits. 


5.2 Reduction of Multidimensional Models 


5.2.1 Hodgkin-Huxley model 


Let us again consider the Hodgkin-Huxley model 


Ik Ina Ty, 
CV = I — gxn'(V — Ex) — gnam°h(V — Ena) — gt (V — Ft), 
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Figure 5.17: Voltage- and Ca?*-gated minimal models. [,...,J, are hypothetical 
currents that could exist theoretically, but have never been recorded experimentally 
(see text). 


fi = (Moo(V) =n) /m(V) 
h = (mo(V)—m)/tm(V) 
h = (heo(V)—h)/m(V), 


with the original values of parameters presented in chapter 2. How can we understand 
the qualitative dynamics of this model? One way, discussed above, is to throw away 
the variable h or n and to reduce this model to the [Nap»+Jk-model or Jya4-model, 
respectively. Although the reduced minimal models can tell a lot about the behavior 
of the original model, they are not equivalent to the Hodgkin-Huxley model from the 
electrophysiological or the dynamical systems point of view. Below we discuss another 
method of reduction of multidimensional electrophysiological models to planar systems. 

The Hodgkin-Huxley model has four independent variables. Early computer simu- 
lations by Krinskii and Kokoz (1973) have shown that there is a relationship between 
the gating variables n(t) and h(t), namely, 


n(t) + h(t) = 0.84 , 


as shown in Fig.5.18. In fact, plotting the variables on the (n,h) plane, as we do in 
Fig.5.19, reveals that the orbit is near the straight line 


h = 0.89 —1.1n. 
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Figure 5.18: The sum n(t) + h(t) & 0.84 in the Hodgkin-Huxley model. Parameters 
are as in chapter 2 and I = 8. 


We can use this relationship in the voltage equation to reduce the Hodgkin-Huxley 
model to a three-dimensional system. If, in addition, we assume that the activation 
kinetics of the Na* current is instantaneous, that is, m = m,(V), then the Hodgkin- 
Huxley model can be reduced to the two-dimensional system 


Ik instantaneous Jn, i, 
: —_—&<_—_———— nn sl. O_O 
CV = I-gxn*(V—Ex) —gnam?,(V)(0.89—1.1n)(V—Ena) — 9L(V—-E,) , 
(No(V) — 2)/Tr(V) , 


n 


whose solutions retain qualitative and some quantitative agreement with the original 
four-dimensional Hodgkin-Huxley system (see Fig.5.20). The first step in the analysis 


Figure 5.19: The relationship between n(t) and 
h(t) in the Hodgkin-Huxley model can be better 
described by h = 0.89 — 1.1n. 
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reduced Hodgkin-Huxley model 


Figure 5.20: Action 
potentials in the origi- 
nal (top) and reduced 
(bottom) Hodgkin- 
Huxley model (I = 8). 
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of any two-dimensional system is to find its nullclines. The V-nullcline can be found 
by numerically solving the equation 


I — gxn*(V — Ex) — gnam3,(V)(0.89—1.1n)(V— Ewa) — gx.(V—E,) = 0 


for n. The nullcline has the familiar N-shape depicted in Fig.5.21. Notice that it 
has only one intersection with the n-nullcline n = n.(V), hence there is only one 
equilibrium, which is stable when J = 0. When the parameter J increases, the equilib- 
rium loses stability via subcritical Andronov-Hopf bifurcation, as discussed in the next 
chapter. When J is sufficiently large (e.g. J = 12 in Fig.5.21), there is a limit cycle 
attractor corresponding to periodic spiking. In exercise 2 we discuss what happens 
when J becomes very large. 
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Figure 5.21: Reduction of the Hodgkin-Huxley model to the (V,7) phase plane. 
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5.2.2 Equivalent Potentials 


Inspired by the reduction idea of Krinskii and Kokoz (1973), Kepler et al. (1992) sug- 
gested a systematic method of reducing the complexity of conductance-based Hodgkin- 
Huxley-type models 


CV = TalVegayeh) 
Li = (Mioo(V) — 2i)/T:(V) , t=1,...,n, 


where £1,...,% is a set of gating variables. The goal is to find certain patterns or 
combinations of the gating variables that can be lumped to reduce the dimension of 
the system. For example, we want to combine all resonant variables operating on a 
similar time scale into a “master” recovery variable, then do the same for amplifying 
variables. 

Let us convert each variable x;(t) to the equivalent potential v;(t) that satisfies 


Lis Mico (U4) : 


In other words, the equivalent potential is the voltage which, in a voltage clamp, would 
give the value x7; when the model is at an equilibrium. Applying the chain rule to 
Y= ee (x;), we express the model above in terms of equivalent potentials: 


CV = I-IV, miol1),..-,MneolUn)) ; 
Vi = (Mioo(V) — Mioo(vi))/(TH(V) Mj. (vi) - 


Since the Boltzmann functions m;,..(V) are invertible, the denominators do not vanish. 
No approximations have been made yet; the new model is entirely equivalent to the 
original one — it is just expressed in a different coordinate system. The new coordinates, 
however, expose many patterns among the equivalent voltage variables that were not 
obvious in the original, gating coordinate system. 

Kepler et al. (1992) developed an algorithm that replaces resonant and amplifying 
variables with their weighted averages. The weights are found using Lagrange mul- 
tipliers and strictly local criteria aimed at preserving the bifurcation structure of the 
model. There is also a set of tests that informs the user when the method is likely 
to fail. The method results in a lower-dimensional system that is easier to simulate, 
visualize, and understand. 


5.2.3. Nullclines and I-V Relations 


We saw that the form and the position of nullclines provided important information 
about the neuron dynamics, that is, the number of equilibria, their stability, the exis- 
tence of limit cycle attractors, and so on. The same information, in principle, can also 
be obtained from the analysis of the neuronal current-voltage (I-V) relations. This is 
not a coincidence, since there is a profound relationship between nullclines and exper- 
imentally measured I-V curves. 
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Figure 5.22: Voltage-clamp protocol to measure instantaneous (peak) and steady-state 
current-voltage (I-V) relations. (Shown are simulations of the [yap»+/k-model from 
Fig.5.4b.) 


Let us illustrate the relationship by using the [y,,,+J/«-model, which we write in 
the form 


CV = I-4(V)—g(V —£x), (5.3) 
g IVa) (5.4) 


where 
In(V) = gt(V—E,) + gnaMoo(V)(V — Ena) 


is the instantaneous (peak) current, and g = gxn is the slow conductance. The function 
f(V,g) describes the dynamics of g, and its form is not important here. The method 
described below is quite general, and it can be used in many circumstances when little 
is known about the neuron’s electrophysiology. 

In Fig.5.22 we describe a typical voltage-clamp experiment to measure the instan- 
taneous (peak) and the steady-state I-V relations, denoted here as Jp(V) and I,.(V), 
respectively. The holding voltage (Fig.5.22a, bottom) is kept at Ex and then stepped 
to various values V. The recorded current (Fig.5.22a, top) typically consists of a fast 
(peak) component Jp(V) that is due to the instantaneous activation of Na* currents, 
leak current, and other fast currents, and then it relaxes to the asymptotic steady-state 
value I,,(V). Repeating this experiment for various V, one can measure the I-V func- 
tions Io(V) and J,.(V) depicted in Fig.5.22b. Note that J9(V) has the N-shape with a 
large region of negative slope. This region corresponds to the regenerative activation 
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of the Na* current, and it is responsible for the excitability property of the neuron. It 
is also responsible for the N-shape of the V-nullcline, as we see next. 
Once the I-V relations are found, we can find the nullclines of the system (5.3, 5.4). 
From the equation 
I~ In(V) — g(V — Ex) =0 


we can easily find the V-nullcline 
g= {1 —1(V)}/(V — Ex) (V-nullcline) , 


which has the inverted N-shape depicted in Fig.5.22c because Ip(V) does. While mea- 
suring [..(V), we hold V long enough so that all conductances reach their steady-state 
values. The steady-state value g = gx.(V) can be obtained from the equation 


I—In(V) — gV — Ex) = —In(V) , 


which says that the asymptotic steady-state current is the sum of the steady-state fast 
current and steady-state slow current. Therefore, 


g={I4+1.(V) — In(V)}/(V — Ex) (g-nullcline) 


depicted in Fig.5.22c. Since we used the Jya,»t+/«-model with parameters as in Fig.5.4b 
(top), we are not surprised that the V- and g-nullclines found here have the same shape 
and relative position as those in Fig.5.4b (top). In exercise 5 we further explore the 
relationship between the I-V curves and neuronal dynamics. 


5.2.4 Reduction to Simple Model 


All models discussed in this chapter can be reduced to two-dimensional systems having 
a fast voltage variable, V, and a slower “recovery” variable, wu, with N-shaped and sig- 
moidal nullclines, respectively. The decision to fire or not to fire is made at the resting 
state, which is the intersection of the nullclines near the left knee, as we illustrate in 
Fig.5.23a. To model the subthreshold behavior of such neurons and the initial segment 
of the upstroke of an action potential, we need to consider only a small neighborhood 
of the left knee confined to the shaded square in Fig.5.23. The rest of the phase space 
is needed only to model the peak and the downstroke of the action potential. If the 
shape of the action potential is less important than the subthreshold dynamics leading 
to this action potential, then we can retain detailed information about the left knee 
and its neighborhood, and simplify the vector field outside the neighborhood. This 
approach results in a simple model capable of exhibiting quite realistic dynamics, as 
we will see in chapter 8. 


Derivation via Nullclines 


The fast nullcline in Fig.5.23b can be approximated by the quadratic parabola 


U = Umin + p(V = Vw) 
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Figure 5.23: Phase portrait (a) and its magnification (b) of a typical neuronal model 
having voltage variable V and a recovery variable u. 


where (Vinin, Umin) is the location of the minimum on the left knee, and p > 0 is a 
scaling coefficient. Similarly, the slow nullcline can be approximated by the straight 
line 
u=s(V—WV), 

where s is the slope and Vo is the V-intercept. All these parameters can easily be 
determined geometrically or analytically. 

Using these nullclines, we approximate the dynamics in the shaded region in Fig.5.23 
by the system 


= ‘Tf {p(V — Vesta —_ (u _ thin) ; 
a = T.{s(V—Vo)—u} , 
where the parameters 7; and 7, describe the fast and slow time scales. Because of 
the term (V — Vnin)?, the variable V can escape to infinity in a finite time. This 
corresponds to the firing of an action potential, more precisely, to its upstroke. To 


model the downstroke, we assume that Vax is the peak value of the action potential, 
and we reset the state of the system 


(V, u) = (Vices uU+ Ueeek) ) when V= Vales 


as if the spiking trajectory disappears at the right edge and appears at the left edge 
in Fig.5.23b. Here Vyreset and Ureset are parameters. Appropriate rescaling of variables 
transforms the simple model into the equivalent form 


= I+v’-y ifv>1, then (5.5) 
= a(buv —u) vecutcutd (5.6) 


having only four dimensionless parameters. 
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-k(V-Vr)(V-Vt)+b(v-vr) 


ra 

() 

5 -k(v-vr)(V-vt) Figure 5.24: The relationship between 
0 the parameters of the simple model 


(5.7, 5.8) and the instantaneous and 
steady-state I-V relations, [9(V) and 
I,.(V), respectively. 


membrane potential, v 


Derivation via I-V Relations 


The parameters of the simple model can be derived using instantaneous (peak) and 
steady-state I-V relations. Let us represent the model in the equivalent form 


Cv = k(v—v,)(v-—u,) —ut] if v > Vpeak, then (act) 
au = a{b(v—v,)—u} vec,ucuctd (5.8) 


where v is the membrane potential, u is the recovery current, and C’ is the mem- 
brane capacitance. The quadratic polynomial —k(v — v,)(v — v4) approximates the 
subthreshold part of the instantaneous I-V relation J[o(V). Here, vu, is the resting mem- 
brane potential, and vu; is the instantaneous threshold potential, as in Fig.5.24. That 
is, instantaneous depolarizations above vu, result in spike response. The polynomial 
—k(v — v,)(v — vy) + b(v — v,) approximates the subthreshold part of the steady-state 
LV relation [.,.(V). When b < 0, its maximum approximates the rheobase current of 
the neuron, i.e., the minimal amplitude of a DC current needed to fire a cell. Its 
derivative with respect to v at v = v,, that is, b—k(v, —v,), corresponds to the resting 
input conductance, which is the inverse of the input resistance. Knowing both the 
rheobase and the input resistance of a neuron, one can use the two equations above to 
determine the parameters k and b. We do that in chapter 8 using recordings of real 
neurons. This method does not work when b > 0. 


The sum of all slow currents that modulate the spike generation mechanism is 
combined in the phenomenological variable u, with outward currents taken with the 
plus sign. The form of (5.8) ensures that u = 0 at rest (ie., when J = 0 and v = »,). 
The sign of b determines whether u is an amplifying (b < 0) or a resonant (b > 0) 
variable. In the latter case, the neuron sags in response to hyperpolarized pulses of 
current, peaks in response to depolarized subthreshold pulses, and produces rebound 
(postinhibitory) responses. The recovery time constant is a. The spike cutoff value is 
Upeak, aNd the voltage reset value is c. The parameter d describes the total amount of 
outward minus inward currents activated during the spike and affecting the after-spike 
behavior. All these parameters can easily be fit to any particular neuron type, as we 
show in chapter 8. 
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Review of Important Concepts 


e Amplifying gating variables describe activation of an inward current 
or inactivation of an outward current. They amplify voltage changes. 


Resonant gating variables describe inactivation of an inward current 
or activation of an outward current. They resist voltage changes. 


To exhibit excitability, it is enough to have one amplifying and one 
resonant gating variable in a neuronal model. 


Many models can be reduced to two-dimensional systems with one 
equation for voltage and instantaneous amplifying currents, and one 
equation for a resonant gating variable. 


The behavior of a two-dimensional model depends on the position 
of its nullclines. Many models have an N-shaped V-nullcline and a 
sigmoid-shaped nullcline for the gating variable. 


There is a relationship between nullclines and I-V curves. 


Quite different electrophysiological models can have similar null- 
clines, and hence essentially the same dynamics. 


The spike generation mechanism of detailed electrophysiological 
models depends on the dynamics near the left knee of the fast V- 
nullcline, and it can be captured by a simple model (5.5, 5.6). 


Bibliographical Notes 


Richard FitzHugh pioneered the use of phase planes and nullclines to study the Hodgkin- 
Huxley model (FitzHugh 1955). First, he used an analog computer, consisting of op- 
erational amplifiers, function generators, and vacuum tubes, to simulate the model. 
According to FitzHugh (see Izhikevich and FitzHugh 2006), the tubes were contin- 
ually failing, and he had to find and replace several tubes a week. The heat from 
all these tubes overloaded the air conditioning, so that on hot summer days he had 
to take off his shirt and wear shorts to be comfortable. Not surprisingly, FitzHugh 
came up with a simple model with N-shaped cubic V-nullcline and a straight-line slow 
nullcline, known as the FitzHugh-Nagumo model, to illustrate the mechanism of ex- 
citability of the Hodgkin-Huxley system. However, it was Krinskii and Kokoz (1973) 
who first discovered the relationship n(t) + h(t) * const, and thus were able to re- 
duce the four-dimensional Hodgkin-Huxley model to a two-dimensional system. Since 
then, the phase plane analysis of neuronal models has become standard, at least in 
Russian-language literature. 
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Current awareness of the geometrical methods of phase plane analysis of neuronal 
models is mostly due to the seminal paper by John Rinzel and Bard Ermentrout Anal- 
ysis of Neural Excitability and Oscillations, published as a chapter in Koch and Segev’s 
book Methods in Neuronal Modeling (1989, 2nd ed., 1999). Not only did they introduce 
the geometrical methods to a wide computational neuroscience audience, but they also 
were able to explain a number of outstanding problems, such as the origin of Class 1 
and 2 excitability observed by Hodgkin in 1948. 

Rinzel and Ermentrout illustrated most of the concepts using the Morris-Lecar 
(1981) model, which is a Jc, + J«-minimal voltage-gated model equivalent of the Ina.p 
+ Ix-model considered above. Due to its simplicity, the Morris-Lecar model is widely 
used in computational neuroscience research. This is the reason we use its analogue, 
the Ina» + [k-model, throughout the book. 

Hutcheon and Yarom (2000) suggested classifying all currents into amplifying and 
resonant. There have been no attempts to classify various electrophysiological mech- 
anisms of excitability in neurons, though minimal models, such as the Iya ~-model or 
the Ic¢at+tix(c)-model, would not surprise most researchers. The other models would 
probably look bizarre to classical electrophysiologists, though they provide a good 
opportunity to practice geometrical phase plane analysis and support FitzHugh’s ob- 
servation that an N-shaped V-nullcline is the key characteristic of neuronal dynamics. 
Izhikevich (2003) took advantage of this observation and suggested the simple model 
(5.5, 5.6) that captures the spike generation mechanism of many known neuronal types 
(see chapter 8). 


Exercises 


1. Show that the J,-model cannot have a limit cycle attractor when J, has instan- 
taneous activation kinetics. (Hint: Use the Bendixson criterion.) 


2. When the injected DC current J or the Nat maximal conductance gna in the 
INa,pt+x-model has a large value, the excited state (V *% —20 mV) becomes 
stable. Sketch possible intersections of nullclines of the model. 


3. Using I as a bifurcation parameter, determine the saddle-node bifurcation dia- 
gram of 


e The Jya4-model with parameters as in Fig.5.6a. 


e The J,4-model with parameters as in Fig.5.14a. 
4. Why is g in Fig.5.22c negative when V is hyperpolarized? 


5. In Fig.5.25 we plot the currents that constitute the right-hand side of the voltage 
equation (5.3), 


_ Teast (V ) and Taow( V ) = g(V ae Ex) , 
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on the (V,J/) plane. The curves define fast and slow movements of the state of 
the system. Interpret the figure. (Hint: Treat the curves as “sort-of” nullclines. ) 


. Show that the Jc¢j+Jx-model can have oscillations. (Hint: Inject negative DC 


current so that the voltage-gated Cl~ current becomes inward/amplifying). 


. (NMDA+Jx-model) Show that a neuronal model consisting of an NMDA current 


and a resonant current, (say, Jk) can exhibit excitability and periodic spiking. 


. The Nernst potential of an ion is a function of its concentration inside/outside the 


cell membrane, which may change. Consider the INap+Ena([Na]in/out)-model 
and show that it can exhibit excitability and oscillations on a slow time scale. 


. Determine when the J,-model has a limit cycle attractor without assuming 


Tr(V) << Tal): 


[Ph.D.] There are Na*-gated and Cl--gated currents in addition to the Ca?*- 
gated currents considered in this book. In addition, the Nernst potentials may 
change as concentrations of ions inside/outside the cell membrane change. This 
may lead to new minimal models. Classify and study all these models. 


Chapter 6 


Bifurcations 


Neuronal models can be excitable for some values of parameters, and fire spikes period- 
ically for other values. These two types of dynamics correspond to a stable equilibrium 
and a limit cycle attractor, respectively. When the parameters change, e.g., the injected 
DC current in Fig.6.1 ramps up, the models can exhibit a bifurcation — a transition 
from one qualitative type of dynamics to another. We consider transitions away from 
equilibrium point in section 6.1 and transitions away from a limit cycle in section 6.2. 
All these transitions can be reliably observed when only one parameter, in our case J, 
changes. Mathematicians refer to such transitions as bifurcations of codimension-1. In 
this chapter we provide definitions and examples of all codimension-1 bifurcations of an 
equilibrium and a limit cycle that can occur in two-dimensional systems. In section 6.3 
we mention some codimension-1 bifurcations in high-dimensional systems, as well as 
some codimension-2 bifurcations. In chapter 7 we discuss how the type of bifurcation 
determines a cell’s neurocomputational properties. 


6.1 Equilibrium (Rest State) 


A neuron is excitable because its resting state is near a bifurcation, i.e., near a transi- 
tion from quiescence to periodic spiking. Typically, such a bifurcation can be revealed 
by injecting a ramp current, as we do in Fig.6.1. The four bifurcations in the figure have 
qualitatively different properties, summarized in Fig.6.2. In this section we use analyt- 
ical and geometrical tools to understand what the differences among the bifurcations 
are. 

Recall (see chapter 4) that an equilibrium of a dynamical system is stable if all the 
eigenvalues of the Jacobian matrix at the equilibrium have negative real parts. When 
a parameter, say J, changes, one of two events can happen: 


1. A negative eigenvalue increases and becomes 0. This happens at the saddle-node 
bifurcation, and the equilibrium disappears. 


2. Two complex-conjugate eigenvalues with negative real parts approach the imag- 
inary axis and become purely imaginary. This happens at the Andronov-Hopf 
bifurcation, and the equilibrium loses stability but does not disappear. 
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saddle-node bifurcation 


‘ 


saddle-node on invariant circle bifurcation 


subcritical Andronov-Hopf bifurcation 


100 ms x 
-60 mV nA 


Figure 6.1: Transitions from resting to tonic (periodic) spiking occur via bifurcations of 
equilibrium (marked by arrows). Saddle-node on invariant circle bifurcation: in vitro 
recording of pyramidal neuron of rat’s primary visual cortex. Subcritical Andronoy- 
Hopf bifurcation: in vitro recording of brainstem mesencephalic V neuron. The other 
two traces are simulations of the [ya)+/«-model. 
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Bifurcation of an equilibrium eer Amplitude Frequency 
oscillations of spikes of spikes 
saddle-node no nonzero nonzero 
saddle-node on invariant circle no nonzero AVI-}, > 0 
supercritical Andronov-Hopf yes As/T=]y =-0 nonzero 
subcritical Andronov-Hopf yes nonzero nonzero 


Figure 6.2: Summary of codimension-1 bifurcations of an equilibrium. J denotes the 
amplitude of the injected current, [, is the bifurcation value, and A is a parameter 
that depends on the biophysical details. 


Thus, there are only two qualitative events that can happen with a stable equilibrium 
in a dynamical system of arbitrary dimension: it can either disappear or lose stability. 
Of course, there could also be a third event: all eigenvalues continue to have negative 
real parts, in which case the equilibrium remains stable. 


Since any equilibrium of a neuronal model is the zero of the steady-state I-V curve 
I,.(V) (the net current at the equilibrium must be zero), analysis of the shape of the 
I-V curve can provide invaluable information about possible bifurcations of the resting 
state. 


Two typical steady-state I-V curves are depicted in Fig.6.3. The I-V curve in 
Fig.6.3a has a region with a negative slope and thus may have three equilibria: the 
left equilibrium is probably stable (though it might be unstable; see exercise 8), the 
middle is unstable, and the right equilibrium can be stable or unstable, depending on 
the kinetics of the gating variables (it is stable in the one-dimensional case, i.e., when 
gating variables have instantaneous kinetics). The I-V curve in Fig.6.3b is monotone. 
A positive (inward) injected DC current J shifts the I-V curves down. This leads to the 
disappearance of the equilibrium in Fig.6.3a, but not in Fig.6.3b. Therefore, Fig.6.3a 
corresponds to the saddle-node bifurcation and Fig.6.3b to the Andronov-Hopf bifur- 
cation. Exactly when the equilibrium loses stability in Fig.6.3b cannot be inferred 
from the I-V relations (for this, we need to consider the full neuronal model). But 
what we can infer is that the bifurcation cannot be of the saddle-node type. Surpris- 
ingly, nonmonotonic I-V curves result in saddle-node bifurcations but do not exclude 
Andronov-Hopf bifurcations, as the reader is asked to demonstrate in exercise 8. This 
phenomenon is relevant to the cortical pyramidal neurons considered in chapter 8. 
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Figure 6.3: Steady-state I-V curves of the Iyap)+J/x-model with high-threshold (left) 
and low-threshold (right) K* current (parameters as in Fig.4.1). 


6.1.1 Saddle-Node (Fold) 


We provided the definition of a saddle-node bifurcation in one-dimensional systems 
in section 3.3.4, and the reader is encouraged to look at that section and at Fig.4.31 
before proceeding further. 

A k-dimensional dynamical system 


t= 70) 4 ze R* 


having an equilibrium point x,, for some value of the bifurcation parameter b,, (i-e., 
f (@sn; 0sn) = 0) exhibits saddle-node (also known as fold) bifurcation if the equilibrium 
is non-hyperbolic with a simple zero eigenvalue, the function f is non-degenerate, and 
it is transversal with respect to b. The first condition is easy to check: 


e Non-hyperbolicity. The Jacobian k x k matrix of partial derivatives at the equilib- 
rium (see section 4.2.2) has exactly one zero eigenvalue, and the other eigenvalues 
have nonzero real parts. 


In general, the remaining two conditions have complicated forms, since they involve 
projections of the vector field on the center manifold, which is tangent to the eigenvector 
corresponding to the zero eigenvalue of the Jacobian matrix. However, there is a 
shortcut for conductance-based neuronal models. 

Let I(V, b) denote the steady-state I-V relation, which can be measured experimen- 
tally, divided by the membrane capacitance C. For example, I(V, J) = {J —In(V)}/C 
when the injected DC current J is used as a bifurcation parameter. We replace the 
multi-dimensional neuronal model with the one-dimensional system V = I(V,b). From 
I(V,b) = 0 (equilibrium condition) we find b = I,,(V). Non-hyperbolicity implies 
IV(V, b) = 0, so that the bifurcation occurs at the local maxima and minima of J,,(V). 
We considered all these properties in chapter 3. 
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e Non-degeneracy. The second-order derivative of I(V,bs,) with respect to V is 
nonzero, that is, 
ss OP1(V, den) 
2 av? 
That is, the piece of the I-V curve, [,,(V), at the bifurcation point, Vs, looks 
like the square parabola. 


20. Lat Vai). (6.1) 


e Transversality. Function I(V, b) is non-degenerate with respect to the bifurcation 
parameter 6; that is, 

O1(Ven, b) 
Ob 
This condition is always satisfied when the injected DC current J is the bifurcation 

parameter, because 01/0b = OI/OI = 1/C. 


The saddle-node bifurcation has codimension-1 because only one condition (non-hyper- 
bolicity) involves strict equality (“=”), and the other two involve inequalities (“”). 
The dynamics of multi-dimensional neuronal systems near a saddle-node bifurcation 
can be reduced to that of the topological normal form 


V =c(b— dn) + a(V — Ven)? , (6.2) 
where V is the membrane voltage, and a and c¢ are defined above. In the context of 


neuronal models, this equation with an after-spike resetting is called the quadratic 
integrate-and-fire neuron, which we discuss in chapters 3 and 8. 


#0 (ate) 4 


C= 


Example: The [ya ,+Jk-model 


Let us use the [Na p»t+Jx-model (4.1, 4.2) with a high-threshold K* current to illustrate 
these conditions. The saddle-node bifurcation occurs when the V-nullcline touches the 
n-nullcline, as in Fig.6.4. Solving the equations numerically, we find that this occurs 
when J,, = 4.51 and (Ven, Msn) = (—60.935, 0.0007). The Jacobian matrix at the 


equilibrium, 
tf 0.0435 —290 
~ \ 0.00015 —1 })”’ 
has two eigenvalues, A; = 0 and Ay = —0.9565, with corresponding eigenvectors 


7 1 ‘ 7 1 
"1=\ 9.00015 wa TAN -Gioae: sts 


depicted in the inset in Fig.6.4. (It is easy to check that Lv; = 0 and Lug = —0.9565v9.) 
The non-degeneracy and transversality conditions yield a = 0.1887 and c = 1, so that 
the topological normal form for the [Na p»+I/«-model is 


V = (I — 4.51) + 0.1887(V + 61)’, (6.3) 
which can be solved analytically. The corresponding bifurcation diagrams are depicted 


in Fig.6.5. It is no surprise that there is a fairly good match when J is near the 
bifurcation value. 
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Figure 6.4: Saddle-node bifurcation in the Inapt+Jx-model (4.1, 4.2) with high- 
threshold Kt current (parameters as in Fig.4.la) and J = 4.51. 
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Figure 6.5: Bifurcation 
diagrams of the topological 
normal form (6.3) and the 
TNap+Ix-model (4.1, 4.2). 
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6.1.2 Saddle-Node on Invariant Circle 


As its name indicates, saddle-node on invariant circle bifurcation (also known as SNIC 
or SNLC bifurcation) is a standard saddle-node bifurcation described above with an 
additional condition: it occurs on an invariant circle, compare Fig.6.6a and 6.6b. 
Here, the invariant circle consists of two trajectories, called heteroclinic trajectories 
connecting the node and the saddle. It is called invariant because any solution starting 
on the circle remains on the circle. As the saddle and node coalesce, the small trajectory 
shrinks and the large heteroclinic trajectory becomes a homoclinic invariant circle, i.e., 
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(a) saddle-node bifurcation 
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(6) saddle-node on invariant circle (SNIC) bifurcation 


node Saddle 


Figure 6.6: Two types of saddle-node bifurcation. 


originating and terminating at the same point. When the point disappears, the circle 
becomes a limit cycle. 

Both types of the bifurcation can occur in the [yap,+J/«-model, as we show in 
Fig.6.7. The difference between the top and the bottom of the figure is the time 
constant T(V) of the Kt current. Since the Kt current has a high threshold, the 
time constant does not affect dynamics at rest, but it makes a huge difference when 
an action potential is generated. If the current is fast (top), it activates during the 
upstroke, thereby decreasing the amplitude of the action potential, and deactivates 
during the downstroke, thereby resulting in overshoot and another action potential. 
In contrast, the slower Kt current (bottom) does not have time to deactivate during 
the downstroke, thereby resulting in undershoot (short afterhyperpolarization), with 
V going below the resting state. 

From the geometrical point of view, the phase portraits in Fig.6.6b and in Fig.6.7 
(bottom), have the same topological structure: there is a homoclinic trajectory (an 
invariant circle) that originates at the saddle-node point, leaves its small neighborhood 
(to fire an action potential), then reenters the neighborhood, and terminates at the 
saddle-node point. This homoclinic trajectory is a limit cycle attractor with infinite 
period, which corresponds to firing with zero frequency. This and other neurocompu- 
tational features of saddle-node bifurcations are discussed in the next chapter. Below, 
we only explore how the frequency of oscillation depends on the bifurcation parameter, 
e.g., on the injected DC current J. 
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Figure 6.7: Saddle-node bifurcation in the Iya»+/x-model with a high-threshold kK* 
current can be off the limit cycle (top) or on the invariant circle (bottom). Parameters 
are as in Fig.4.la with 7(V) = 0.152 (top) or T(V) = 1 (bottom). 
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Figure 6.8: The Inap»t+Jk-model can fire a periodic train of action potentials with 
arbitrary small frequency when it is near a saddle-node on invariant circle bifurcation. 
The trajectory moves fast from point B to A (a spike) and slowly in the shaded region 
from point A to B. The segment labeled “tan t” behaves like tant in the limit of 
infinitesimal proximity to the bifurcation. 
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A remarkable fact is that one can estimate the frequency of the large-amplitude limit 
cycle attractor by considering a small neighborhood of the saddle-node point. Indeed, 
a trajectory on the limit cycle generates a fast spike from point B to A in Fig.6.8 and 
then slowly moves from A to B (shaded region in the figure) because the vector field 
(the velocity) in the neighborhood between A and B is very small. The duration of the 
stereotypical action potentials, denoted here as 7}, is relatively constant and does not 
depend much on the injected current J. In contrast, the time spent in the neighborhood 
(A, B) depends significantly on J. Since the behavior in the neighborhood is described 
by the topological normal form (6.2), we can estimate the time the trajectory spends 
there in terms of the parameters a, b, and c (see exercise 3). This yields 


a 
ac(b — bey) 

where the parameters a, b, and c are those defined in the previous section. Thus, the 

period of one oscillation is T = T) + To. 

Figure 6.8 (top) illustrates the accuracy of this estimation, using the Ina pt+lk- 
model, whose topological normal form (6.3) was derived earlier. The duration of the 
action potential is 7, = 4.7 ms, and the length of time the voltage variable spends in 
the shaded neighborhood (A,B) (here —61 +11 mV) is approximated by 


7 


~ \/0.1887(1 — 4.51) 


(ms). 


1) 


The analytical curve 
1000 


Ww = ——— 

Tye 5 
matches the numerically found frequency of oscillation (Fig.6.8, top) in a fairly broad 
frequency range. For comparison, we plot the curve 1000/72 to show that neglecting 
the duration of the spike, 7, can be justified only when I is very close to the bifurcation 
point. 


(Hz) 


6.1.3. Supercritical Andronov-Hopf 


If a neuronal model has a monotonic steady-state I-V relation, a saddle-node bifurca- 
tion cannot occur. The resting state in such a model does not disappear, but it loses 
stability, typically via an Andronov-Hopf (sometimes called Hopf) bifurcation. The 
loss of stability is accompanied either by the appearance of a stable limit cycle (super- 
critical Andronov-Hopf) or by the disappearance of an unstable limit cycle (subcritical 
Andronoy-Hopf). 

Let us consider a two-dimensional system 


v = F(v,u, b) 
au = G(v, u, b) 
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and suppose that (v,u) = (0,0) is an equilibrium when the bifurcation parameter 
b = 0, that is, F(0,0,0) = G(0,0,0) = 0. This system undergoes an Andronov-Hopf 
bifurcation at the equilibrium if the following three conditions are satisfied: 


e Non-hyperbolicity. The Jacobian 2 x 2 matrix of partial derivatives at the equi- 
librium (see section 4.2.2), 
Fy Py 
r=(6 a), 


has a pair of purely imaginary eigenvalues, +iw € C with w 4 0. That is, 
trh=F)+G,=0 and w j= det b= FG, = FG, > Vatosustb=0. 
The linear change of variables 


v=2 and Fyu=—Fy,x —wy (6.5) 


converts (6.4) into the form 


8 
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where the functions 
f(t,y)=Fv,u)+wy and g(x,y) = -(MF(v, u) + FuGlv, u))/w — wx 
have no linear terms in x and y. Now we are ready to state the other two conditions: 


e Non-degeneracy. The parameter 


1 1 
ate {fave + feyy + Gory + Suvuh + FE {foy( fox + fyy) — Gny(Gaa + Gyy) — frxGan + FyyIuy} 
(6.7) 
is nonzero. 


e Transversality. Let c(b) + iw(b) denote the complex-conjugate eigenvalues of the 
Jacobian matrix of (6.4) for b near 0, with c(0) = 0 and w(0) = w. The real part, 
c(b), must be non-degenerate with respect to b, that is, c’(0) 4 0. 


The codimension of Andronov-Hopf bifurcation is one, since only one condition involves 
strict equality (tr L = 0), and the other two involve inequalities (“A”). 

The sign of a determines the type of the Andronov-Hopf bifurcation, depicted in 
Fig.6.9: 


e Supercritical Andronov-Hopf bifurcation occurs when a < 0. It corresponds to a 
stable limit cycle appearing from a stable equilibrium. 


e Subcritical Andronov-Hopf bifurcation occurs when a > 0. It corresponds to an 
unstable limit cycle shrinking to a stable equilibrium. 


170 Bifurcations 


Z 
stable © ____.unstable equilibrium, _unstable 
equilibrium /| equilibrium 


Figure 6.9: Andronov- 
Hopf bifurcation: A 
stable equilibrium 
becomes unstable in 
the system (6.8, 6.9). 
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Figure 6.10: Polar coordinates: r is the amplitude 
(radius) and ¢ is the phase (angle) of oscillation. 


Finding a in applications can be challenging. A few useful examples are considered in 
exercises 14-18. 

Any system undergoing an Andronov-Hopf bifurcation can be reduced to the topo- 
logical normal form by a change of variables (see also exercise 4) 


* = ce(b)r+ar’, (6.8) 
Q w(b) + dr?, (6.9) 


where r > 0 is the amplitude (radius), and y is the phase (angle) of oscillation, as in 
Fig.6.10, and a, b, c(b), and w(b) are as above. 

The function c(b) in the normal form (6.8, 6.9) determines the stability of the 
equilibrium r = 0 corresponding to a non-oscillatory state (stable for c < 0 and unstable 
for c > 0, regardless of the value of a). The function w(b) determines the frequency of 
damped or sustained oscillations around this state. The parameter d describes how the 
frequency of oscillation depends on its amplitude. A state-dependent change of time 
can remove the term dr? from (6.9) (Kuznetsov 1995), so many assume d = 0 to start 
with. 
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Figure 6.11: Supercritical Andronov-Hopf bifurcation in the [Nap»+/«-model with low- 
threshold Kt current: As the bifurcation parameter J increases, the equilibrium loses 
stability and gives birth to a stable limit cycle with growing amplitude. Parameters 
are as in Fig.4.1b. 
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Figure 6.12: Supercritical Andronov-Hopf bifurcation in the [y,,p»+J«-model with low- 
threshold K* current (see Fig.6.11). Dots represent numerical simulation of the full 
model, continuous curves represent analytical results using the topological normal form 
(6.8, 6.9). 


Example: The [y,,+/x-Model 


Let us use the Inapt+J«K-model with low-threshold K* current in Fig.6.11 to illustrate 
the three conditions above. As the magnitude of the injected DC current J increases, 
the equilibrium loses stability and gives birth to a stable limit cycle with growing 
amplitude. Using simulations we find that the bifurcation occurs when J,, = 14.66 
and (Van, Nan) = (—56.5, 0.09). The Jacobian matrix at the equilibrium, 


1 —335 
= ( 0.0166 —1 ) 


has a pair of complex conjugate eigenvalues +2.14i, so the non-hyperbolicity condition 
is satisfied. Next, we find numerically (in Fig.6.12 or analytically in exercise 9) that 
the eigenvalues at the equilibrium can be approximated by 


c(I)+u(Di x 0.03{1 — 14.66} + (2.14 + 0.04{7 — 14.66})i 


in a neighborhood of the bifurcation point J = 14.66. Since the slope of c(J) is nonzero, 
the transversality condition is also satisfied. Using exercise 17 we find that a = —0.0026 
and d = —0.0029, so that the non-degeneracy condition is also satisfied, and the 
bifurcation is of the supercritical type. The corresponding topological normal form is 


0.03{I — 14.66}r — 0.0026r°, 
~ = (2.144 0.04{7 — 14.66}) — 0.0029r?. 


r 


To analyze the normal form, we consider the r-equation and neglect the phase variable 
y. From 
r(c(b) + ar?) =0 
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Figure 6.13: Supercritical Andronov-Hopf bifurcation in (6.8, 6.9) with c = +1 and 
a = —1 (negative values of the radial polar coordinate r do not have any physical 
meaning). 


we conclude that r = 0 is an equilibrium for any value of c(b). Since 
(c(b)r + ar®), = c(b) at r = 0, 


the equilibrium is stable for c(b) < 0 and unstable for c(b) > 0, as we illustrate in 
Fig.6.13. Indeed, the resting state in the [ja»+J«-model is stable when J < 14.66 and 
unstable when I > 14.66. 

When c(b) > 0, the normal form has a family of stable periodic solutions with 
amplitude 


r= Vc(b)/|al and (frequency) = w(b) + dc(b)/la] . 


Hence, the Iyapt+J/«-model has a family of periodic attractors with 


r= 0.0341 — 14.66} /0.0026 
and 


(frequency) = (2.14 + 0.04{7 — 14.66}) — 0.0029 - 0.03{7 — 14.66}/0.0026 , 
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Figure 6.14: Phase portrait of 
the INap+J«-model: An unstable 
limit cycle (dashed circle) is 
often surrounded by a stable one 
(solid circle) in two-dimensional 
neuronal models. 
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a 


membrane voltage, V (mV) 


depicted in Fig.6.12. We see that the topological normal form describes the full 
INap+Ixk-model near the Andronov-Hopf bifurcation not only qualitatively but also 
quantitatively. 


6.1.4 Subcritical Andronov-Hopf 


Neuronal models with monotonic steady-state I-V relations can often exhibit subcritical 
Andronoy-Hopf bifurcations, as we illustrate in Fig.6.16, using the [Na,p)+J«-model hav- 
ing a low-threshold K* current and a steep activation curve for the Na* current. The 
stable equilibrium in such a system is surrounded by an unstable limit cycle (dashed 
circle), which is often surrounded by another stable cycle, as in Fig.6.14 (not depicted 
in Fig.6.16 for clarity). As the magnitude of the injected DC current J increases, the 
unstable cycle shrinks to the stable equilibrium and makes it lose stability. Systems 
undergoing such a bifurcation satisfy the same three conditions — non-hyperbolicity, 
non-degeneracy, and transversality — presented in the previous section, and they can 
be reduced to the topological normal form (6.8, 6.9) with positive a. 

Analysis of the normal form shows that the stability of the non-oscillatory equilib- 
rium r = 0 depends on the sign of c(b): 


e When c(b) < 0 (see Fig.6.15, left), there is a pair of equilibria, r = +,/|c(b)|/a 
corresponding to an unstable periodic solution that shrinks to r = 0 as c(b) > 0 
and makes the stable equilibrium r = 0 lose its stability. 


e When c(b) > 0 (see Fig.6.15, right), the non-oscillatory state r = 0 is unstable, 
and all trajectories diverge from it. 


This behavior can be clearly seen in Fig.6.16. 
Finally, note that there is always a bistability (co-existence) of the resting attrac- 
tor and some other attractor near a subcritical Andronov-Hopf bifurcation in two- 
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Figure 6.15: Subcritical Andronov- 
Hopf bifurcation in (6.8, 6.9) with 
é=]21 gnda¢= 1, 


dimensional conductance-based models, as in Fig.6.14 (in non-neural models, the tra- 
jectories can go to infinity and there need not be bistability). The bistability must 
also be present at the saddle-node bifurcation of an equilibrium, but may or may not 
be present at the saddle-node on invariant circle or at a supercritical Andronov-Hopf 
bifurcation. 


Delayed Loss of Stability 


In Fig.6.17a we inject a ramp of current into the Iyap+J/«-model to drive it slowly 
through the subcritical Andronov-Hopf bifurcation point J ~ 48.75 (see Fig.6.16). We 
choose the ramp so that the bifurcation occurs exactly at t = 100. Even though the 
focus equilibrium is unstable for t > 100, the membrane potential remains near -50 
mV, as if the equilibrium were still stable. This phenomenon, discovered by Shishkova 
(1973), is called delayed loss of stability. It is ubiquitous in simulations of smooth 
dynamical systems near subcritical or supercritical Andronov-Hopf bifurcations. 

The mechanism of delayed loss of stability is quite simple. The state of the system 
is attracted to the stable focus while t < 100. Even though the focus loses stability 
at t = 100, the state of the system is infinitesimally close to the equilibrium, so it 
takes a long time to diverge from it. The longer the convergence to the equilibrium, 
the longer the divergence from it; hence the noticeable delay. The delay has an upper 
bound that depends on the smoothness of the dynamical system (Nejshtadt 1985). 
It can be shortened or even reversed (advanced loss of stability) by weak noise that 
is always present in neurons. This may explain why the delay has never been seen 
experimentally despite the fact that it is practically unavoidable in simulations. 
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Figure 6.16: Subcritical Andronov-Hopf bifurcation in the Jy,,,)+J«-model. As the bi- 
furcation parameter J increases, an unstable limit cycle (dashed circle; see also Fig.6.14) 
shrinks to an equilibrium and makes it lose stability. Parameters are as in Fig.4.1b, 
except gr = 1, gna = 9k = 4, and the Na* activation function has Vj;2 = —30 mV and 
k=. 
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Figure 6.17: Delayed loss of stability (a) and noise-induced sustained oscillations (b) 
near subcritical Andronov-Hopf bifurcation. Shown are simulations of the Ina p»+lk- 
model with parameters as in Fig.6.16 and the same initial conditions. Small conduc- 
tance noise is added in (b) to unmask oscillations. 


Unmasking of Oscillations by Noise 


In Fig.6.17b we repeat the same simulation as in Fig.6.17a except that we add a weak 
conductance noise to the Ija»+JK-model. Starting with the same initial conditions, 
the system converges to the stable focus equilibrium, as expected, exhibiting damped 
oscillations of membrane potential. After a while, however, it diverges from the equi- 
librium and exhibits sustained waxing and waning oscillations, as if there were a small 
amplitude limit cycle attractor with a variable amplitude. The oscillations persist until 
the state of the system escapes from the attraction domain of the stable focus, which 
is bounded by the unstable limit cycle, to the attraction domain of the large-amplitude 
stable limit cycle. 
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Let us explain how weak noise unmasks damped oscillations and makes them sus- 
tained. It is convenient to treat noise as a series of perturbations that push the mem- 
brane potential in random directions, often away from the resting state. Each such 
perturbation evokes a damped oscillation toward the resting state. Superposition of 
many such damped oscillations, occurring at different times, results in the waxing 
and waning rhythmic activity seen in the figure (see also exercise 3 in chapter 7). In 
chapters 8 and 9 we present many examples of noise-induced sustained oscillations in 
biological neurons, and in chapter 7 we study their neurocomputational properties. 


6.2 Limit Cycle (Spiking State) 


In section 6.1 we considered all codimension-1 bifurcations of equilibria, which typically 
correspond to transitions from resting to spiking states in neuronal models. Below 
we consider all codimension-1 bifurcations of limit cycle attractors on a phase plane. 
These bifurcations typically correspond to transitions from repetitive spiking to resting 
behavior, as we illustrate in Fig.6.19, and they will be important in chapter 9 where 
we consider bursting dynamics. 

In Fig.6.18 we summarize how the bifurcations affect a periodic attractor. Saddle- 
node on invariant circle and saddle homoclinic orbit bifurcations involve homoclinic 
trajectories having an infinite period (zero frequency). They result in oscillations with 
drastically increasing interspike intervals as the system approaches the bifurcation state 
(see Fig.6.19). 

In contrast, supercritical Andronov-Hopf bifurcation results in oscillations with 
vanishing amplitude, as one can clearly see in Fig.6.19. If neither the frequency nor 
the amplitude vanishes, then the bifurcation is of the fold limit cycle type. Indeed, 


Bifurcation of a limit cycle attractor | Amplitude Frequency 


saddle-node on invariant circle nonzero AVI-f, > 0 
supercritical Andronov-Hopf AV/I-I, 7 0 nonzero 
fold limit cycle nonzero nonzero 
saddle homoclinic orbit nonzero In > 0 


Figure 6.18: Summary of codimension-1 bifurcations of a limit cycle attractor on a 
plane. J denotes the amplitude of the injected current, J, is the bifurcation value, and 
A is a parameter that depends on the biophysical details. 
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Figure 6.19: Transitions from tonic (periodic) spiking to resting occur via bifurca- 
tions of limit cycle attractors (marked by arrows). Saddle-node on invariant circle 
bifurcation: recording of layer 5 pyramidal neuron in rat’s visual cortex. Supercritical 
Andronoy-Hopf bifurcation: excitation block in pyramidal neuron of rat’s visual cor- 
tex. Fold limit cycle bifurcation: brainstem mesencephalic V neuron of rat. Saddle 
homoclinic orbit bifurcation: neuron in pre-Boltzinger complex of rat brainstem. (Data 
provided by C. A. Del Negro and J. L. Feldman.) 
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the amplitude and the interspike period are constant before the arrow in Fig.6.19 
corresponding to the fold limit cycle bifurcation. Damped small-amplitude oscillation 
after the arrow occurs because of oscillatory convergence to the equilibrium. 

We start with a brief review of the saddle-node on invariant circle and the supercrit- 
ical Andronov-Hopf bifurcations, which we considered in detail in section 6.1. These 
bifurcations can explain not only transitions from rest to spiking but also transitions 
from spiking to resting states. Then we consider fold limit cycle and saddle homoclinic 
orbit bifurcations. 


6.2.1 Saddle-Node on Invariant Circle 


A stable limit cycle can disappear via a saddle-node on invariant circle bifurcation as 
depicted in Fig.6.20. The necessary condition for such a bifurcation is that the steady- 
state I-V relation is not monotonic. We considered this bifurcation in section 6.1.2 
as a bifurcation from an equilibrium to a limit cycle; that is, from left to right in 
Fig.6.20. Now consider it from right to left. As a bifurcation parameter changes, 
e.g., the injected DC current J decreases, a stable limit cycle (circle in Fig.6.20, right) 
disappears because there is a saddle-node bifurcation (Fig.6.20, center) that breaks the 
cycle and gives birth to a pair of equilibria— stable node and unstable saddle (Fig.6.20, 
left). After the bifurcation, the limit cycle becomes an invariant circle consisting of a 
union of two heteroclinic trajectories. 

Depending on the direction of change of a bifurcation parameter, the saddle-node 
on invariant circle bifurcation can explain either appearance or disappearance of a 
limit cycle attractor. In either case, the amplitude of the limit cycle remains relatively 
constant, but its period becomes infinite at the bifurcation point because the cycle 
becomes a homoclinic trajectory to the saddle-node equilibrium (Fig.6.20, center). As 
we showed in section 6.1.2 (see Fig.6.8), the frequency of oscillation scales as WI — I, 
when the bifurcation parameter approaches the bifurcation value J). 


bifurcation <__bifurcation parameter changes changes 
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Figure 6.20: Saddle-node on invariant circle (SNIC) bifurcation of a limit cycle attrac- 
tor. 
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Figure 6.21: Supercritical Andronov-Hopf bifurcation of a limit cycle attractor. 


6.2.2 Supercritical Andronov-Hopf 


A stable limit cycle can shrink to a point via supercritical Andronov-Hopf bifurcation 
in Fig.6.21, which we considered in section 6.1.3. Indeed, as the bifurcation parameter 
changes, e.g., the injected DC current J in Fig.6.11 decreases, the amplitude of the limit 
cycle attractor vanishes, and the cycle becomes a stable equilibrium. As we showed 
in section 6.1.3 (see Fig.6.12), the amplitude scales as WJ — J, when the bifurcation 
parameter approaches the bifurcation value J). 
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Figure 6.22: Fold limit cycle bifurcation: a stable and an unstable limit cycle approach 
and annihilate each other. 


6.2.3. Fold Limit Cycle 


A stable limit cycle can appear (or disappear) via the fold limit cycle bifurcation 
depicted in Fig.6.22. Consider the figure from left to right, which corresponds to the 
disappearance of the limit cycle, and hence to the disappearance of periodic spiking 
activity. As the bifurcation parameter changes, the stable limit cycle is approached by 
an unstable one; they coalesce and annihilate each other. At the point of annihilation, 
there is a periodic orbit, but it is neither stable nor unstable. More precisely, it is stable 
from the side corresponding to the stable cycle (outside in Fig.6.22), and unstable from 
the other side (inside in Fig.6.22). This periodic orbit is referred to as a fold (also known 
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as a saddle-node) limit cycle, and it is analogous to the fold (saddle-node) equilibrium 
studied in section 6.1. Considering Fig.6.22 from right to left explains how a stable 
limit cycle can appear seemingly out of nowhere: As a bifurcation parameter changes, 
a fold limit cycle appears and then bifurcates into a stable limit cycle and an unstable 
one. 


Fold limit cycle bifurcation can occur in the [Nap+J«K-model having low-threshold 
Kt current, as we demonstrate in Fig.6.23. The top phase portrait, corresponding to 
I = 48, is the same as the one in Fig.6.16. In that figure we studied how the equilib- 
rium loses stability via subcritical Andronov-Hopf bifurcation, which occurs when an 
unstable limit cycle shrinks to a point. We never questioned where the unstable limit 
cycle came from. Neither were we concerned with the existence of a large-amplitude 
stable limit cycle corresponding to the periodic spiking state. In Fig.6.23 we study 
this problem. We decrease the bifurcation parameter J to see what happens with the 
limit cycles. As J approaches the bifurcation value 42.18, the unstable and stable limit 
cycles approach and annihilate each other. When J is less than the bifurcation value, 
there are no periodic orbits, only one stable equilibrium corresponding to the resting 
state. 


Notice that the fold limit cycle bifurcation explains how (un)stable limit cycles 
appear or disappear, but it does not explain the transition from resting to periodic 
spiking behavior. Indeed, let us start with J = 42 in Fig.6.23 and slowly increase 
the parameter. The state of the INapt+J«-model is at the stable equilibrium. When 
I passes the bifurcation value, a large-amplitude stable limit cycle corresponding to 
periodic spiking appears, yet the model is still quiescent, because it is still at the stable 
equilibrium. Thus, the limit cycle is just a geometrical object in the phase space that 
corresponds to spiking behavior. However, for it to actually exhibit spiking, the state 
of the system must somehow be pushed into the attraction domain of the cycle, say by 
external stimulation. This issue is related to the computational properties of neurons, 
and it is discussed in detail in the next chapter. 


In Fig.6.24 we depict the bifurcation diagram of the Iya)+/«-model. For each value 
of I, we simulate the model forward (t — oo) to find the stable limit cycle and backward 
(t —+ —oo) to find the unstable limit cycle. Then we plot their amplitudes (maximal 
voltage minus minimal voltage along the limit cycle) on the (J,V)-plane. One can 
clearly see that there is a fold limit cycle bifurcation (left) and a subcritical Andronov- 
Hopf bifurcation (right). The left part of the bifurcation diagram looks exactly like the 
one for saddle-node bifurcation, which explains why the fold limit cycle bifurcation is 
often referred to as fold or saddle-node of periodics. 


The similarity of the fold limit cycle bifurcation and the saddle-node bifurcation 
is not a coincidence. Stability of limit cycles can be studied using Floquet theory or 
Poincare cross-section maps (Kuznetsov 1995), or by brute force (e.g., by reducing 
the model to an appropriate polar coordinate system). When a limit cycle attractor 
undergoes fold limit cycle bifurcation, its radius undergoes saddle-node bifurcation. 
(This is a hint for exercise 10.) 
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Figure 6.23: Fold limit cycle bifurcation in the Iya,+J«-model. As the bifurcation 
parameter J decreases, the stable and unstable limit cycles approach and annihilate 
each other. Parameters are as in Fig.6.16. 
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Figure 6.24: Bifurcation diagram of the Jya,)+/«-model. Parameters are as in Fig.6.16. 
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Figure 6.25: Saddle homoclinic orbit bifurcation. 
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Figure 6.26: Two bifurcations involving homoclinic trajectories to an equilibrium. 


6.2.4 Homoclinic 


A limit cycle can appear or disappear via a saddle homoclinic orbit bifurcation, as 
depicted in Fig.6.25. As the bifurcation parameter changes, the cycle becomes a ho- 
moclinic orbit to the saddle equilibrium, and its period becomes infinite. After the 
bifurcation, the cycle no longer exists. A necessary condition for such a bifurcation is 
that the steady-state I-V relation is not monotonic. 

One should be careful to distinguish the saddle homoclinic orbit bifurcation from 
the saddle-node on invariant circle bifurcation depicted in Fig.6.26. Indeed, it might 
be easy to confuse these bifurcations, since both involve an equilibrium and a large- 
amplitude homoclinic trajectory that becomes a limit cycle. The key difference is that 
the equilibrium is a saddle in the former and a saddle-node in the latter. The saddle 
equilibrium persists as the bifurcation parameter changes, whereas the saddle-node 
equilibrium disappears or bifurcates into two points, depending on the direction of 
change of the bifurcation parameter. 

Recall that a saddle on a plane has two real eigenvalues of opposite signs. Their 
sum, A; + Ag, is called the saddle quantity. 


e If A; +A, < 0, then the saddle homoclinic orbit bifurcation is supercritical, which 
corresponds to the (dis)appearance of a stable limit cycle. 


e If Ay + Ag > 0, then the saddle homoclinic orbit bifurcation is subcritical, which 
corresponds to the (dis)appearance of an unstable limit cycle. 


Thus, the saddle quantity plays the same role as the parameter a in the Andronov-Hopf 
bifurcation. The supercritical saddle homoclinic orbit bifurcation is more common in 
neuronal models than the subcritical one for the reason explained in section 6.3.6. 
Hence, we consider only the supercritical case below, and we drop the word “supercrit- 
ical” for the sake of brevity. 
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Figure 6.27: Saddle homoclinic orbit bifurcation 
occurs when the stable and unstable submanifolds of 
the saddle make a loop. 


A useful way to look at the bifurcation is to note that the saddle has one stable and 
one unstable direction on a phase plane. There are two orbits associated with these 
directions, called the stable and unstable submanifolds, depicted in Fig.6.27. Typically, 
the submanifolds miss each other, that is, the unstable submanifold goes either inside 
or outside the stable one. This could happen for two different values of the bifurcation 
parameter. One can imagine that as the bifurcation parameter changes continuously 
from one value to the other, the submanifolds join at some point and form a single 
homoclinic trajectory that starts and ends at the saddle. 

The saddle homoclinic orbit bifurcation is ubiquitous in neuronal models, and it can 
easily be observed in the INap+J«-model with fast K* conductance, as we illustrate 
in Fig.6.28. Let us start with J = 7 (top of Fig.6.28) and decrease the bifurcation 
parameter J. First, there is only a stable limit cycle corresponding to periodic spiking 
activity. When J decreases, a stable equilibrium and an unstable equilibrium appear 
via saddle-node bifurcation (not shown in the figure), but the state of the model is still 
on the limit cycle attractor. Further decrease of J moves the saddle equilibrium closer 
to the limit cycle (case J = 4 in the figure), until the cycle becomes an infinite period 
homoclinic orbit to the saddle (case I * 3.08), and then disappears (case J = 1). At 
this moment, the state of the system approaches the stable equilibrium, and the tonic 
spiking stops. 

Similar to the fold limit cycle bifurcation, the saddle homoclinic orbit bifurcation 
explains how the limit cycle attractor corresponding to periodic spiking behavior ap- 
pears and disappears. However, it does not explain the transition to periodic spiking 
behavior. Indeed, when J = 4 in Fig.6.28, the limit cycle attractor exists, yet the neu- 
ron may still be quiescent because its state may be at the stable node. The periodic 
spiking behavior appears only after external perturbations push the state of the system 
into the attraction domain of the limit cycle attractor, or J increases further and the 
stable node disappears via a saddle-node bifurcation. 

We can use linear theory to estimate the frequency of the limit cycle attractor 
near the saddle homoclinic orbit bifurcation. Because the vector field is small near 
the equilibrium, the periodic trajectory passes slowly through a small neighborhood 
of the equilibrium, then quickly makes a rotation and returns to the neighborhood, 
as we illustrate in Fig.6.29. Let 7) denote the time required to make one rotation 
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Figure 6.28: Saddle homoclinic orbit bifurcation in the [y,,+J/x-model with parameters 
as in Fig.4.la and fast Kt current (7(V) = 0.16). As the bifurcation parameter [ 
decreases, the stable limit cycle becomes a homoclinic orbit to a saddle. 
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Figure 6.29: The period of the limit cycle is T = 7, + Ty with T, — oo as the cycle 
approaches the saddle equilibrium. Shown is the [ya,,)+J/«K-model with J = 3.5. 


(dashed part of the limit cycle in the figure) and T2 denote the time spent in the 
small neighborhood of the saddle equilibrium (continuous part of the limit cycle in the 
shadowed region), so that the period of the limit cycle is T = T, + To. While T, is 
relatively constant, 72 — oo as I approaches the bifurcation value fj, = 3.08, and the 
limit cycle approaches the saddle. In exercise 11 we show that 


where A, is the positive (unstable) eigenvalue of the saddle, and 7 is a parameter that 
depends on the size of the neighborhood, global features of the vector field, and so on. 
We can represent the period, 7’, in the form 


TU) = —Infn(s —I,)}, 


where a single parameter tT; = Te~*!™ accounts for all global features of the model, 
including the width of the action potential and the shape of the limit cycle. One can 
easily determine 7, if the eigenvalue A, and the period of the limit cycle are known for 
at least one value of J. The Iyap+J«-model has 7; = 0.2, as we show in Fig.6.30. Note 
that the theoretical frequency 1000/7'(/) matches the numerically found frequency in 
a broad range. Also note how imprecise the numerical results are (see inset in the 
figure). 

Both the saddle-node on invariant circle bifurcation and the saddle homoclinic orbit 
bifurcation result in spiking with decreasing frequency, so that their frequency-current 
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Figure 6.30: Frequency of spiking in the Jya,+Jx-model with parameters as in 

Fig.6.28 near a saddle homoclinic orbit bifurcation. Dots are numerical results; the 

continuous curve is w(J) = 1000A(7)/{—In(0.2(7 — 3.0814))}, where the eigenvalue 

A(1) = 0.87/4.51 — I was obtained from the normal form (6.3). The inset shows a 

magnified region near the bifurcation value J = 3.0814. 


Figure 6.31: Big saddle homoclinic orbit bifurcation. 


(F-I) curves go continuously to zero. The key difference is that the former asymptotes 
as V1 — Jy, and the latter as 1/In(J—J,). The striking feature of the logarithmic decay 
in Fig.6.30 is that the frequency is greater than 100 Hz and the theoretical curve does 
not seem to go to zero for all J except those in an infinitesimal neighborhood of the 
bifurcation value [,. Such a neighborhood is almost impossible to catch numerically, 
let alone experimentally in real neurons. 


Many neuronal models, and even some cortical pyramidal neurons (see Fig.7.42) 
exhibit a saddle homoclinic orbit bifurcation depicted in Fig.6.31. Here, the unstable 
manifold of a saddle returns to the saddle along the opposite side, thereby making a 
big loop; hence the name big saddle homoclinic orbit bifurcation. This kind of bifurca- 
tion often occurs when an excitable system is near a codimension-2 Bogdanov-Takens 
bifurcation considered in section 6.3.3, and it has the same properties as the “small” 
homoclinic orbit bifurcation considered above: it can be subcritical or supercritical, 
depending on the saddle quantity; it results in a logarithmic F-I curve; and it implies 
the coexistence of attractors. All methods of analysis of excitable systems near “small” 
saddle homoclinic orbit bifurcations can also be applied to the case in Fig.6.31. 
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Figure 6.32: Heteroclinic orbit bifurcation does not change the existence or stability of 
any equilibrium or periodic orbit. 


6.3 Other Interesting Cases 


Saddle-node and Andronov-Hopf bifurcations of equilibria, combined with fold limit 
cycle, homoclinic orbit bifurcation, and heteroclinic orbit bifurcation (see Fig.6.32), 
exhaust all possible bifurcations of codimension-1 on a plane. These bifurcations can 
also occur in higher-dimensional systems. Below we discuss additional codimension-1 
bifurcations in three-dimensional phase space, and then we consider some codimension- 
2 bifurcations that play an important role in neuronal dynamics. The beginning reader 
may read only section 6.3.6 and skip the rest. 


6.3.1 ‘Three-Dimensional Phase Space 


So far we have considered four bifurcations of equilibria and four bifurcations of limit 
cycles on a phase plane. These eight bifurcations can appear in multidimensional 
systems. Below we briefly discuss the kinds of bifurcations that are possible in a 
three-dimensional phase space but cannot occur on a plane. 

First, there are no new bifurcations of equilibria in multidimensional phase space. 
Indeed, what could possibly happen with the Jacobian matrix of an equilibrium of a 
multidimensional dynamical system? A simple zero eigenvalue would result in a saddle- 
node bifurcation, and a simple pair of purely imaginary complex-conjugate eigenvalues 
would result in an Andronov-Hopf bifurcation. Both are exactly the same as in the 
lower-dimensional systems already considered. Thus, adding dimensions to a dynamical 
system does not create new possibilities for bifurcations of equilibria. 

In contrast, adding the third dimension to a planar dynamical system creates new 
possibilities for bifurcations of limit cycles, some of which are depicted in Fig.6.33. 
Below we briefly describe these bifurcations. 

The saddle-focus homoclinic orbit bifurcation in Fig.6.33 is similar to the saddle 
homoclinic orbit bifurcation considered in section 6.2.4, except that the equilibrium 
has a pair of complex-conjugate eigenvalues and a nonzero real eigenvalue. The ho- 
moclinic orbit originates in the subspace spanned by the eigenvector corresponding to 
the real eigenvalue (as in Fig.6.33) and terminates along the subspace spanned by the 
eigenvectors corresponding to the complex-conjugate pair. The reverse direction is also 
possible. Depending on the direction and the relative magnitude of the eigenvalues, 
this bifurcation can result in the (dis)appearance or a stable (supercritical) or unstable 
(subcritical) twisted large-period orbit. 
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Figure 6.33: Some codimension-1 bifurcations of limit cycles in three-dimensional phase 
space (modified from Izhikevich 2000a). 
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The subcritical flip bifurcation in Fig.6.33 occurs when a stable periodic orbit is sur- 
rounded by an unstable orbit of twice the period. The unstable periodic orbit shrinks 
to the stable one and makes it lose stability. This bifurcation is similar to the pitch- 
fork bifurcation studied below, except that it has codimension-1 (pitchfork bifurcation 
has infinite codimension unless one considers dynamical systems with symmetry). A 
supercritical flip bifurcation is similar, except that an unstable cycle is surrounded by 
a stable double-period cycle. 

The subcritical Neimark-Sacker bifurcation in Fig.6.33 occurs when a stable peri- 
odic orbit is surrounded by an unstable invariant torus. The latter shrinks and makes 
the periodic orbit lose its stability. In some sense, which we will not elaborate on here, 
this bifurcation is similar to the subcritical Andronov-Hopf bifurcation of an equilib- 
rium. The supercritical Neimark-Sacker bifurcation occurs when an unstable orbit is 
surrounded by a stable invariant torus. 

The blue-sky catastrophe in Fig.6.33 occurs when a small-amplitude stable limit 
cycle disappears and a large-amplitude large-period stable orbit appears out of nowhere 
(from the blue sky). The orbit has an infinite period at the bifurcation, yet it is 
not homoclinic to any equilibrium. A careful analysis shows that the large orbit is 
homoclinic to the small limit cycle at the moment the cycle disappears. In some sense, 
which we elaborate on later, this bifurcation is similar to the saddle-node on invariant 
circle bifurcation (see exercise 20). In particular, both bifurcations share the same 
asymptotics. 

The fold limit cycle on homoclinic torus bifurcation in Fig.6.33 is similar to the 
blue-sky catastrophe except that the disappearance of the small periodic orbit results 
in a large-amplitude torus (quasi-periodic) attractor. 


6.3.2 Cusp and Pitchfork 


Recall that an equilibrium 2, of a one-dimensional system 4 = f(z,b) is at a saddle- 
node bifurcation when f, = 0 (first derivative of f) but fi, 4 0 (second derivative 
of f) at the equilibrium. The latter is called the non-degeneracy condition, and it 
guarantees that the system dynamics is equivalent to that of « = c(b) + 2. 

If f, = 0 and f,, = 0, but frre #0, then the equilibrium is at the codimension-2 
cusp bifurcation, and the behavior of the system near the equilibrium can be described 
by the topological normal form 


& = c1(b) + co(b)z + az, 


where 
c1(b) = f (ap, d) ) €2(b) = fr(Zp, ) ) a= free /0 FO; 


in particular, c, = cz = 0 at the cusp point. The cusp bifurcation is supercritical when 
a <0 and subcritical otherwise. It is explained by the shape of the surface 


eee tar =0:, 


depicted in Fig.6.34. 
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Let us treat cj and cg as independent parameters, and check that there are saddle- 
node bifurcations in any neighborhood of the cusp point. The bifurcation sets of the 
topological normal form can easily be found. Differentiating c; + cox + ax? with respect 
to x gives c2+3ax?. Equating both of these expressions to zero and eliminating x gives 
two saddle-node bifurcation curves 


2 C2 3/2 
ans (@)” 
; lal \3 


depicted at the bottom of Fig.6.34. Since c, = c,(b) and cy = c9(b), varying the 
bifurcation parameter b results in a path on the (c;, c2)-plane. Depending on the shape 
and location of this path, one can get many one-dimensional bifurcation diagrams. A 
summary of some special cases is depicted in Fig.6.35, showing that there can be many 
interesting dynamical regimes in the vicinity of a cusp bifurcation point. 


x am | ten. 


Figure 6.35: Summary of special cases for the supercritical cusp bifurcation. Dotted 
segments are paths c; = ci(b), co = c2(b), where b is a one-dimensional bifurcation 
parameter. The corresponding bifurcation diagrams are depicted in boxes. Continuous 
curves represent stable solutions, dashed curves represent unstable solutions. (Modified 
from Hoppensteadt and Izhikevich 1997.) 
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Figure 6.36: Pitchfork bifurcation diagrams. 


An important special case is when c; = 0 and c2(b) = 6, so that the topological 
normal form is 


¢ = br +az’. 


This form corresponds to a pitchfork bifurcation, whose diagram is depicted in Fig.6.36 
(see also the bottom bifurcation diagram in Fig.6.35). This bifurcation has an infinite 
codimension unless one considers dynamical systems with symmetry, such as, ¢ = 


f(x,b) with f(—a,b) = —f (a,b) for all x and b. 


6.3.3. Bogdanov-Takens 


Can an equilibrium undergo Andronov-Hopf and saddle-node bifurcations simultane- 
ously? There are two possibilities, illustrated in Fig.6.37: 


e Fold-Hopf. The Jacobian matrix at the equilibrium has a pair of pure imagi- 
nary complex-conjugate eigenvalues (Andronov-Hopf bifurcation) and one zero 
eigenvalue (saddle-node bifurcation). In this case the two bifurcations occur in 
different subspaces. 


e (Bogdanov-Takens) The Jacobian matrix has two zero eigenvalues. In this case 
the two bifurcations occur in the same subspace. 


The fold-Hopf bifurcations occur in systems having dimension 3 and up, while the 
Bogdanov-Takens bifurcation can occur in two-dimensional systems. Both bifurcations 
have codimension-2; that is, they require two bifurcation parameters. Note that the 
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Figure 6.37: Two ways an equilibrium can undergo a saddle-node (fold) and an 
Andronov-Hopf bifurcation simultaneously. 


fold-Hopf bifurcation has three eigenvalues with zero real part, whereas the Bogdanov- 
Takens bifurcation has only two zero eigenvalues. This bifurcation can, on the one 
hand, be viewed as a saddle-node bifurcation in which another (negative) eigenvalue 
gets arbitrarily close to zero, and, on the other hand, as an Andronov-Hopf bifurcation 
in which the imaginary part of the complex-conjugate eigenvalues goes to zero. 

The Jacobian matrix of an equilibrium at the Bogdanov-Takens bifurcation satisfies 
two conditions: det L = 0 (saddle-node bifurcation) and tr L = 0 (Andronov-Hopf 
bifurcation). For example, it can have the form 


L=() ae (6.10) 


Because of these two conditions, the codimension of this bifurcation is 2. There are 
also certain non-degeneracy and transversality conditions (see Kuznetsov 1995). The 
corresponding topological normal form, 


“=v, 


v=at+but+u?+ouv, er) 


has two bifurcation parameters, a and b, and the parameter 0 = +1 determines whether 
the bifurcation is subcritical or supercritical. This parameter depends on the combi- 
nation of the second-order partial derivatives with respect to the first variable, and it 
is nonzero because of the non-degeneracy conditions (Kuznetsov 1995). The bifurca- 
tion diagram and representative phase portraits for various a,b, and o are depicted in 
Fig.6.38 (the case 0 > 0 can be reduced to o < 0 by the substitutions t > —t and 
v — —v). A remarkable fact is that the saddle-node and the Andronov-Hopf bifurca- 
tions do not occur alone. There is also a saddle homoclinic orbit bifurcation always 
appearing near the Bogdanov-Takens point. 

Bogdanov-Takens bifurcation often occurs in neuronal models with nullclines inter- 
secting as in Fig.6.39a. We show in the next chapter that this bifurcation separates 
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Figure 6.38: Bogdanov-Takens (BT) bifurcation diagram of the topological normal form 
(6.11). Abbreviations: AH, Andronov-Hopf bifurcation; SN, saddle-node bifurcation; 
SHO, saddle homoclinic orbit bifurcation. 


integrators from resonators, and it can occur in some layer 5 pyramidal neurons of rat 
visual cortex, as we discuss in section 7.2.11 and 8.2.1. The two equilibria in the lower 
(left) knee of the fast nullcline in Fig.6.39b are not necessarily a saddle and a stable 
node, but can be a saddle and an (un)stable focus, as in the phase portraits in Fig.6.38. 


Interestingly, the global vector field structure of neuronal models with nullclines 
as in Fig.6.39a results in the birth of a spiking limit cycle attractor via a big saddle 
homoclinic orbit bifurcation, so the neuronal model undergoes a cascade of bifurcations, 
depicted in Fig.6.40, as the amplitude of the injected current J increases. The local 
phase portraits corresponding to Jp, [;, and Iz are topologically equivalent to the phase 
portrait “1” in Fig.6.38 (right). (The equivalence is local near the left knee; there is 
no global equivalence because of the extra equilibrium in Fig.6.40 and because of the 
big homoclinic or periodic orbit.) As J increases, a stable large-amplitude spiking 
limit cycle appears via a big supercritical homoclinic orbit bifurcation at some J,. It 
coexists with the stable resting state for all J, < I < Js. At some point Jy, the 
saddle quantity, i.e., the sum of its eigenvalues, changes from negative to positive 
(it is zero at the Bogdanoy-Takens bifurcation), so another saddle homoclinic orbit 
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Figure 6.39: Intersection of nullclines of a two-dimensional system, resulting in 
Bogdanov-Takens bifurcation. 


bifurcation (at some J/3) occurs, which is subcritical, giving birth to an unstable limit 
cycle. The phase portrait at [3 is locally topologically equivalent to the one marked 
SHO in Fig.6.38. Similarly, the phase portrait at I, is locally equivalent to the one 
labeled “2” in Fig.6.38. The unstable cycle shrinks to the equilibrium and makes it lose 
stability via a subcritical Andronov-Hopf bifurcation at some Js, which corresponds to 
case AH in Fig.6.38. Further increase of J converts the unstable focus into an unstable 
node, which approaches the saddle and disappears via the saddle-node bifurcation SN, 
in Fig.6.38 (not shown in Fig.6.40). 


subcritical 
Andronov-Hopf 
bifurcation 


homoclinic orbit 


Figure 6.40: Transformations of phase portraits of a neuronal model near the sub- 
critical Bogdanov-Takens bifurcation point as the magnitude of the injected current [ 
increases (here J,4, > J,). Shaded regions are the attraction domains of the equilib- 
rium corresponding to the resting state. 
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Figure 6.41: Canard (French duck) limit cycles in a relaxation oscillator (hand draw- 
ing). 


6.3.4. Relaxation Oscillators and Canards 


Let us consider a relaxation oscillator 


oc = j(e.y,b) (fast variable) 
= g(a, u,b) (slow variable) 


with fast and slow nullclines, as in Fig.6.4la, and 4 < 1. Suppose that there is a 
stable equilibrium, as in Fig.6.41a, for some values of the bifurcation parameter b < 0, 
and a stable limit cycle, as in Fig.6.41h, for some other values b > 0. What kind of 
bifurcation of the equilibrium occurs when b increases from negative to positive, and 
the slow nullcline passes the left knee of the fast N-shaped nullcline? 

The Jacobian matrix at the equilibrium has the form 


_ ( tee dy ) 
Mgz HGy 

Since f;, = 0 at the knee (prove this), but f, typically does not, the Jacobian matrix 
resembles the one for the Bogdanov-Takens bifurcation (6.10) in the limit w = 0. 
However, the resemblance is only superficial, since the relaxation oscillator does not 
satisfy the non-degeneracy conditions. In particular, second-order partial derivatives 
of g(x,y, b) vanish in the limit pw — 0, resulting in o = 0 and in the disappearance of 
the term u? from the topological normal form (6.11). 

A purely geometrical consideration confirms that the transition from Fig.6.4la 
to Fig.6.41h cannot be of the Bogdanov-Takens type, since there is a unique equi- 
librium and no possibility for a saddle-node bifurcation, which always accompanies 
the Bogdanov-Takens bifurcation. Actually, the equilibrium loses stability via an 
Andronov-Hopf bifurcation that occurs when 


trL=frtpgy=0 and  detL=p(fegy — fyGe) > 0- 
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The loss of stability typically happens not at the left knee, where f, = 0, but a little to 
the right of the knee, where f;, = —lgy > 0 (because gy < 0 in neuronal models). We 
saw this phenomenon in section 4.2.6 when we considered FitzHugh-Nagumo model. 

An interesting observation is that the period of damped or sustained oscillations 
near the Andronov-Hopf bifurcation point in Fig.6.41b is of the order 1/,/j, because 
the frequency w = Vdet L ® ,/fi, whereas the period of large-amplitude relaxation 
oscillation is of the order 1/1, because it takes 1/j units of time to slide up and 
down along the branches of the fast nullcline in Fig.6.41h. Thus, the period of small 
subthreshold oscillations of a neural model may have no relation to the period of 
spiking, if the model has many time scales. 

The Andronov-Hopf bifurcation can be supercritical or subcritical, depending on the 
functions f and g; see exercise 14 and exercise 18. Figure 6.41 depicts the supercritical 
case. In the subcritical case, stable and unstable limit cycles are typically born via 
fold limit cycle bifurcation; then the unstable limit cycle goes through the shapes as 
in Fig.6.41g, f, e, d, c, and b, and finally shrinks to a point. 


Canards 


The distinctive feature of limit cycles in Fig.6.41c-6.41¢ is that they follow the unstable 
branch (dashed curve) of the fast nullcline before jumping to the left or to the right 
(stable) branch. Due to the relaxation nature of the system, the vector field is hori- 
zontal outside the N-shape fast nullcline, so any transition from Fig.6.41b to Fig.6.41h 
must gradually go through the stages in Fig.6.41c-6.41g. Because the cycle in Fig.6.41f 
resembles a duck, at least in the eyes of the French mathematicians E. Benoit, J.-L. 
Callot, F. Diener, and M. Diener, who discovered this phenomenon in 1977, it is often 
called a canard (French duck) cycle. 

In general, any trajectory that follows the unstable branch is called a canard tra- 
jectory. Canard trajectories play an important role in defining thresholds for resonator 
neurons, as we discuss in section 7.2.5. It takes on the order of 1/j units of time to 
slide along the unstable branch of the fast nullcline. A small perturbation to the left or 
to the right can result in an immediate jump to the corresponding stable branch of the 
nullcline. Hence, the initial conditions should be specified with an unrealistic precision 
of the order of e~!/" to follow the unstable branch, which explains why the canard 
trajectories are difficult to catch numerically, let alone experimentally. Consequently, 
the canard cycles, though stable, exists in an exponentially small region of values of 
the parameter b. A typical simulation shows a sudden explosion of a stable limit cycle 
from small (Fig.6.41b) to large (Fig.6.41h) as the parameter b is slowly varied. In sum- 
mary, canard cycles in two-dimensional relaxation oscillators play an important role of 
thresholds, but they are fragile and rather exceptional. 

In contrast, canard trajectories in three-dimensional relaxation oscillators (one fast 
and two slow variables) are generic in the sense that they exist in a wide range of pa- 
rameter values. A simple way to see this is to treat b as the second slow variable. Then 
there is a set of initial conditions corresponding to the canard trajectories. Studying 
canards in R? goes beyond the scope of this book (see bibliographical notes). 
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Figure 6.42: Supercritical Bautin bifurcation in (6.12); see also Fig.9.42 (left). 


6.3.5 Bautin 


What happens when a subcritical Andronov-Hopf bifurcation becomes supercritical, 
that is, when the parameter a in the topological normal form for Andronoy-Hopf bi- 
furcation (6.8, 6.9) changes sign? The bifurcation becomes degenerate when a = 0, 
and the behavior of the system is described by the topological normal form for Bautin 
bifurcation, which we write here in the complex form 


= (c+ iw)z + az|z|* + aez|z|", (6.12) 


where z € C is a complex variable, and c,a, and a2 are real parameters. The pa- 
rameters a and dy are called the first and second Liapunov (often spelled Lyapunov) 
coefficients. The Bautin bifurcation occurs when a = c = 0 and a2 ¥ 0, and hence it 
has codimension-2. It is subcritical when az > 0 and supercritical otherwise. If az = 0, 
then one needs to consider the next term a3z|z|°, not shown in the normal form (6.12), 
to get a bifurcation of codimension-3, and so on. 

We can easily determine bifurcations of the topological normal form. First of all, 
(6.12) undergoes Andronoy-Hopf bifurcation when c = 0, which is supercritical for 
a < 0 and subcritical otherwise. Moreover, if a and az have different signs, then (6.12) 
undergoes fold limit cycle bifurcation when 


a? — dean = 0, 
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as we illustrate in Fig.6.42. Thus, both Andronov-Hopf and fold limit cycle bifurcations 
occur simultaneously at the Bautin point a = c = 0. Many two-dimensional neuronal 
models, such as the INap+J«-model with low-threshold Kt current, are relatively near 
this bifurcation, which explains why the unstable limit cycle involved in the subcritical 
Andronov-Hopf bifurcation is usually born via fold limit cycle bifurcation. There is 
some evidence that rodent trigeminal interneurons, dorsal root ganglion neurons, and 
mes V neuron in the brainstem are also near this bifurcation; see section 9.3.3. 


6.3.6 Saddle-Node Homoclinic Orbit 


Let us compare the saddle-node on invariant circle bifurcation and the saddle homo- 
clinic orbit bifurcation depicted in Fig.6.43 (top). In both cases there is a homoclinic 
orbit (i.e., a trajectory that originates and terminates at the same equilibrium). How- 
ever, the equilibria are of different types, and the orbit returns to them along different 
directions. Now suppose a system undergoes both bifurcations simultaneously, as we 
illustrate in Fig.6.43 (bottom). Such a bifurcation, called saddle-node homoclinic orbit 
bifurcation, has codimension-2, since two strict conditions must be satisfied. First, the 
equilibrium must be at the saddle-node bifurcation point, i.e., must have the eigen- 
value A; = 0. Second, the homoclinic trajectory must return to the equilibrium along 
the noncentral direction, i.e., along the stable direction corresponding to the nega- 
tive eigenvalue Ay. Since the saddle-node quantity, A; + A2, is always negative, this 
bifurcation always results in the (dis)appearance of a stable limit cycle. 
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Figure 6.43: Saddle-node homoclinic orbit bifurcation occurs when a system undergoes 
a saddle-node on invariant circle and saddle homoclinic orbit bifurcations simultane- 
ously. 
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Figure 6.44: Unfolding of saddle-node homoclinic orbit bifurcation in the [Na pt+Jk- 
model with parameters as in Fig.6.28. 


In Fig.6.44 we illustrate the saddle-node homoclinic orbit bifurcation using the 
INap+Jk-model with two bifurcation parameters: the injected DC current J and the 
K* time constant 7. The bifurcation occurs at the point (J,7) = (4.51, 0.17). Note that 
there are three other codimension-1 bifurcation curves converging to this codimension-2 
point, as we illustrate in Fig.6.45. Since the model undergoes a saddle-node bifurcation 
at J = 4.51 and any 7, the straight vertical line J = 4.51 is the saddle-node bifurcation 
curve. The point 7 = 0.17 on this line separates two cases. When 7 > 0.17, the 
activation and deactivation of the Kt current is sufficiently slow that the membrane 
potential V undershoots the equilibrium, resulting in the saddle-node on invariant circle 
bifurcation. When tT < 0.17, deactivation of the Kt current is fast, and V overshoots 
the saddle-node equilibrium, resulting in the saddle-node off limit cycle bifurcation. 

Shaded triangular areas in the figures denote the parameter region corresponding 
to the bistability of stable equilibrium and a limit cycle attractor (resting and spik- 
ing states). Let us decrease the parameter J and cross such a region from right to 
left. When J = 4.51, a saddle equilibrium and a node equilibrium appear. Further 
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Figure 6.45: Unfolding of saddle-node homoclinic orbit bifurcation. 


decreasing J moves the saddle equilibrium rightward and the limit cycle leftward, until 
they merge. This occurs on the saddle homoclinic orbit bifurcation curve, which is 
determined numerically in Fig.6.44. 

Neuronal models exhibiting saddle-node homoclinic bifurcations can be reduced to 
a topological normal form 


V =c(b— den) ta(V —Ven)?, if V(t) = Vinax, then V(t) — Vieset 5 (6.13) 


which is similar to that for saddle-node bifurcation (6.2), except that there is a reset 
V < Vyeset When the membrane voltage reaches a certain large value Vinax. Any suff- 
ciently large Vinax will work equally well, even Vinax = +00, because V reaches +00 in a 
finite time (see exercise 3). Using Vinax = 30 and results of section 6.1.1, the topological 
normal form for the INa»+/K-model is 


V = (1 —4.51) +0.1887(V + 61)?, if V(t) = 30, then V(t) < Vieset - 


The saddle-node homoclinic bifurcation occurs when J = 4.51 and Vyeset = —61. This 
normal form is called the quadratic integrate-and-fire neuron; see chapters 3 and 8. 

The topological normal form (6.13) is a useful equation, as will be seen in the rest 
of the book. It describes quantitative and qualitative features of neuronal dynamics 
remarkably well, yet it has only one non-linear term. This makes it suitable for real- 
time simulations of huge numbers of neurons. Its bifurcation structure is studied in 
exercise 12 (see also Fig.8.3), and the reader should at least look at the solution at the 
end of the book. 
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6.3.7 Hard and Soft Loss of Stability 


Bifurcation is a qualitative change of the phase portrait of a system. Not all changes 
are equally dramatic, however. Some are hardly noticeable. For example, consider 
an equilibrium undergoing a supercritical Andronov-Hopf bifurcation: as a bifurcation 
parameter changes, the equilibrium loses stability and a small-amplitude stable limit 
cycle appears, as in Fig.6.11. The state of the system remains near the equilibrium; it 
just exhibits small-amplitude oscillations around it. We can change the parameter in 
the opposite direction, and then the limit cycle shrinks to a point and the system returns 
to the equilibrium. In neurons, such a bifurcation does not lead to an immediate spike. 
The neuron remains quiescent; it just exhibits subthreshold small-amplitude sustained 
oscillations. Such a loss of stability is called soft: the equilibrium is no longer stable, 
but its small neighborhood remains attractive. Supercritical pitchfork, cusp, and flip 
bifurcations correspond to soft loss of stability. 

In contrast, if the equilibrium loses stability via subcritical Andronov-Hopf bifur- 
cation, the state of the system diverges from it, which results in an immediate spike or 
some kind of large-amplitude jump. Such a loss of stability is called hard: neither the 
equilibrium nor its neighborhood is attractive. The hard loss of stability usually leads 
to noticeable or catastrophic changes in systems behavior, and the stability boundary 
is called dangerous (Bautin 1949). Changing the bifurcation parameter in the opposite 
direction will make the equilibrium stable again, but may not bring the state of the 
system back to equilibrium. Saddle-node bifurcation is hard unless it is on an invari- 
ant circle. In this case, the loss of stability is catastrophic, i.e., leading to noticeable 
spikes, but reversible. Saddle homoclinic orbit bifurcation is hard. In general, most 
bifurcations in neurons, or at least in neuronal models, are hard. 


Review of Important Concepts 


e Stable equilibrium (resting state) in a typical neuronal model can 
— disappear via saddle-node bifurcation, which can be off or on in- 
variant circle or 
— lose stability via Andronov-Hopf bifurcation, which can be super- 
critical or subcritical. 

These four cases are summarized in Fig.6.46. 


Stable limit cycle (periodic spiking state) in a typical two- 
dimensional neuronal model can 

— be cut by saddle-node on invariant circle bifurcation 

— shrink to a point via supercritical Andronov-Hopf bifurcation 

— disappear via fold limit cycle bifurcation or 

— disappear via saddle homoclinic orbit bifurcation. 

These four cases are summarized in Fig.6.47. 


Some atypical (codimension-2) bifurcations may play important 
roles in neuronal dynamics. 


e Bogdanov-Takens bifurcation separates integrators from resonators. 
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Bibliographical Notes 


Though bifurcation theory can be traced back to Poincare and Andronoy, it is a rela- 
tively new branch of mathematics. The first attempt to apply it to neuroscience was 
in 1955, when Richard FitzHugh concluded his paper on mathematical modeling of 
threshold phenomena by saying that many neuronal properties 
. are invariant under continuous, one-to-one transformations of the coordinates of 
phase space and fall within the domain of topology, a branch of mathematics which 
may be intrinsically better fitted for the preliminary description and classification of 
biological systems than analysis, which includes differential equations. This suggestion 
is of little practical value at present, since too little is known of the topology of vector 
fields in many-dimensional spaces, at least to those interested in theoretical biology. 
Nevertheless, the most logical procedure in the description of a complex biological 
system might be to characterize the topology of its phase space, then to establish 
a set of physically identifiable coordinates in the space, and finally to fit differential 
equations to the trajectories, instead of trying to reach this final goal at one leap. 


It is remarkable that FitzHugh was explicitly talking about topological equivalence 
and bifurcations, though he never called them such, years before these mathematical 
notions were firmly established. This book continues the line of research initiated by 
FitzHugh and further developed by Rinzel and Ermentrout (1989). 

In this chapter we provided a fairly detailed exposition of bifurcation theory. What 
we covered should be sufficient not only for understanding the rest of the book, but 
also for navigating through bifurcation papers concerned with computational neuro- 
science. More bifurcation theory, including bifurcations in mappings %n41 = f(Xn, 9), 
can be found in the excellent book Elements of Applied Bifurcation Theory by Yuri 
Kuznetsov (1995; new ed., 2004), which, however, might be a bit technical for a non- 
mathematician. Some of the bifurcations considered in this chapter, such as the blue- 
sky catastrophe, are classified as “exotic” by Kuznetsov (1995), though the catastrophe 
was recently found in a model of a leech heart interneuron (Shilnikov and Cymbalyuk 
2005). 

There is no unified naming scheme for the bifurcations, mostly because they were 
discovered and rediscovered independently in many fields and in many countries. For 
example, the Andronov-Hopf bifurcation was known to A. Poincare, so some scientists 
refer to it as the Poincare-Andronov-Hopf bifurcation. Many refer to it as just the Hopf 
bifurcation due to the fault of the famous Russian mathematician Vladimir Igorevich 
Arnold and the famous French mathematician Rene Thom. According to Arnold’s 
account, he was visited by Thom in the 1960s. While there were discussing various 
bifurcations, Arnold put too much emphasis on Hopf’s “recent” (1942) paper. As 
a result of Arnold’s misattribution, Thom popularized the bifurcation as the Hopf 
bifurcation. In Fig.6.49 we provide some common alternative names for the bifurcations 
considered in this chapter. The complete list of names of known bifurcations is very 
long, and it resembles the list of faculty members of the Department of Radiophysics 
at Gorky State University, in what is now Nizhnii Novgorod, Russia. The department 
was founded by A. A. Andronov in 1945 (see Fig. 6.50). 
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Figure 6.46: Summary of all codimension-1 bifurcations of a stable equilibrium (resting 
state). 
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Figure 6.47: Summary of all codimension-1 bifurcations of a stable limit cycle (tonic 
spiking state) on a plane. 


208 Bifurcations 


Figure 6.48: Richard FitzHugh with analog computer at the National Institute of 
Health, Bethesda, Maryland, ca. 1960. (Photograph provided by R. FitzHugh). 


bifurcation alternative names 


saddle-node fold, limit point, saddle-node off limit cycle 


saddle-node on invariant circle SNIC, saddle-node on limit cycle (SNLC), circle, 
saddle-node homoclinic, saddle-node central homoclinic, 
saddle-node infinite period (SNIPer), homoclinic 


Andronov-Hopf Hopf, Poincare-Andronov-Hopf 

saddle homociinic orbit homoclinic, saddle-loop, saddle separatrix loop, Andronov-Leontovich 

fold limit cycle saddle-node of limit cycles, double limit cycle, fold cycle, 
saddle-node (fold) of periodics 

saddle-node homoclinic orbit saddle-node noncentral homoclinic, saddle-node separatrix-loop 

Bogdanov-Takens Takens-Bogdanov, double-zero 

Bautin degenerate Hopf, generalized Hopf 

flip period doubling 


Figure 6.49: Popular alternative names for some of the bifurcations considered in this 
chapter. 


Bifurcations 209 


Figure 6.50: The founder of the Russian school of non- 
linear dynamics, Aleksander Aleksandrovich Andronov 
(1901-1952) in 1950. (Picture provided by M. I. Rabi- 
novich. ) 


stable 0 


Figure 6.51: Transcritical bifurcation in ¢ = x(b— 2). 


The division of bifurcations into subcritical and supercritical may be confusing to 
a novice. For example, some scientists erroneously think that supercritical bifurca- 
tions result in the appearance of attractors (stable equilibria, limit cycles, etc.), and 
subcritical bifurcations result in their disappearance. Let us emphasize here that the 
appearance or disappearance of an equilibrium or a limit cycle depends on the direc- 
tion of change of the bifurcation parameter. For example, the subcritical pitchfork 
bifurcation in Fig.6.36 can result in the appearance of a stable equilibrium x = 0 if 
b decreases past 0. Our classification of bifurcations into subcritical and supercritical 
is consistent with the following widely accepted rule: let the bifurcation parameter 
change in the direction leading to the increase in the number of objects (equilibria, 
limit cycles). The bifurcation is supercritical if stable objects appear, subcritical if 
unstable objects appear, and transcritical (as in Fig.6.51) if equal numbers of stable 
and unstable objects appear or disappear. The condition for supercritical (subcritical) 
Andronoy-Hopf bifurcation, (6.7), is taken from Guckenheimer and Holmes (1983). 

Delayed loss of stability was first described by Shishkova (1973), and studied in 
detail by Nejshtadt (1985) (many find his paper difficult to read). An alternative 
description is given by Arnold et al. (1994) and Baer et al. (1989). 
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Canard (French duck) solutions were reported by Benoit et al. (1981). Due to the 
recent political climate in the USA, some refer to “French ducks” as “freedom ducks” , 


probably to emphasize that “French = freedom”. Canards in 


R? were studied by Benoit 


(1984), Samborskij (1985; in IR"), and more recently by Szmolyan and Wechselberger 


(2001, 2004) and Wechselberger (2005). 


Exercises 


1. (Transcritical bifurcation) Justify the bifurcation diagram in Fig.6.51. 


2. Show that the non-degeneracy and transversality conditions are necessary for 
the saddle-node bifurcation. That is, present a system that does not exhibit 


saddle-node bifurcation, but satisfies 


(a) the non-hyperbolicity and non-degeneracy conditions or 


(b) the non-hyperbolicity and transversality conditions. 


3. Consider the model 


V =c(b— den) ta(V — Ven)’, 


with positive a and c, and b > b,,. Show that the sojourn time in a bounded 


neighborhood of the point V = V,, scales as 


7 


(a 
ac(b — bs) 


when 0 is near b,,. (Hint: Find the solution that starts at —oo and terminates 


at +00.) 


4. Show that the two-dimensional system 


au = c(bju—w(bjyv + (au—dv)(u? 
= w(bju+c(bv + (du+av)(u 


the complex-valued system 


+"), (6.14) 


247), (6.15) 


2 = (e(b) + iw(b))z + (at id)z|z\? , 


and the polar-coordinate system 


c(b)\r + ar®, 
~ = w(b)+dr? 


rf 


are equivalent. 
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Figure 6.52: exercise 8: This [Nap»+JK-model has a non-monotonic I-V relation, yet 
the resting state becomes unstable via Andronoy-Hopf bifurcation before disappearing 
via saddle-node bifurcation. Parameters are as in Fig.4.la, except that Ea, = —78 


mV and n..(V) has k = 12 mV. 


. Show that the non-degeneracy and transversality conditions are necessary for the 
Andronov-Hopf bifurcation. That is, present a system that does not exhibit the 
Andronov-Hopf bifurcation, but satisfies 


(a) the non-hyperbolicity and non-degeneracy conditions or 


(b) the non-hyperbolicity and transversality conditions. 


. Show that the system (6.14, 6.15) with c(b) = b, w(b) = 1,a # 0 andd = 0 
exhibits Andronov-Hopf bifurcation. Check all three conditions. 


. Determine the stability of the limit cycle near an Andronov-Hopf bifurcation. 
(Hint: Consider the equilibrium r \/|c/a| in the topological normal form 


(6.8). 


. The model in Fig.6.52 has a non-monotonic I-V relation. Nevertheless, the rest- 
ing state loses stability via Andronoyv-Hopf bifurcation before disappearing via 
saddle-node bifurcation. Draw representative phase portraits of the model. Is 
the system near Bogdanov-Takens bifurcation? 


. Consider a generic two-dimensional conductance-based model 
V 


x 


[—I(V,2) , 
(t00(V) — 2)/7(V) , (6.17) 


212 


Bifurcations 


Figure 6.53: See exercise 11. 


where V and x are the membrane voltage and a gating variable, respectively, I is 
the injected DC current, and I(V,) is the instantaneous I-V relation, which of 
course depends on the gating variable x. Here the membrane capacitance C' = 1 
for the sake of simplicity. Show that the eigenvalues at an equilibrium c +w are 
given by 

e= Uy(V, 2) + 1/r(V))/2 


and 


w= Vc? — IL (V)/T(V) 
where I,,(V) = I(V,2.(V)) is the I-V relation of the model. In 
particular, the frequency at the Andronov-Hopf bifurcation is 


(frequency) = V/Ii,(V)/(Cr(V)) , 


where C' is the membrane capacitance. 


10. Determine when the system 


/ 


2 = (atwi)z+2|z|? — 2|z|*, zEC 


undergoes fold limit cycle bifurcation. 


11. Consider a square neighborhood of a saddle equilibrium in Fig.6.53 (compare 


with the inset in Fig.6.29). Here v, and v2 are eigenvectors with eigenvalues 
Az <0 < Ay. Suppose the limit cycle enters the square at the point a = T(I—J,), 
where T > 0 is some parameter. Determine the amount of time the trajectory 
spends in the square as a function of J. 


12. Determine the bifurcation diagram of the topological normal form (6.13) for 


saddle-node homoclinic bifurcation. 
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13. 


14. 


15. 


hes 


Ae 


Prove that the system 
0 = T4+v*-u, 
u = a(buv—u) 
with a > 0 undergoes 
e saddle-node bifurcation when b? = 4/, 


e Andronov-Hopf bifurcation when a < b and a? — 2ab+4I = 0, 
e Bogdanov-Takens bifurcation when a = 6b = QV/T. 


Use the results of exercise 15 to prove that the Andronov-Hopf bifurcation in the 
model above is always subcritical. 


Use (6.7) to prove that the relaxation oscillator 
flv) -u 

au = plv—b) 
with an N-shaped fast nullcline u = f(v) undergoes Andronov-Hopf bifurcation 
when f’(b) = 0 (i.e., exactly at the knee; what is so special about this model?). 
Show that the bifurcation is supercritical when f(b) < 0 and subcritical when 
7 (0) 0; 
Prove that the Andronov-Hopf bifurcation point in 

vo = F(v)-u 

u (bu — u) 
satisfies F’ = and b > ys. Use (6.7) to show that 


a= {FY + (F")"/(b— p)}/16 . 


Prove that the Andronov-Hopf bifurcation point in 
v = F(v)-u 
4 = p(G(v) — wu) 
satisfies F’ = 1 and G’ > yw. Use (6.7) to show that 
a= {F" + F"(F" — G")/(G’ — w)}/16. 


Prove that the Andronov-Hopf bifurcation point in 
vo = F(v)-(v+l1)u 
wu = p(G(v) —u) 
satisfies F’ = 1 and G’ > yw. Use (6.7) to show that 
a={F" + p—(F"— p)(1+ pl@" — F" + 2y)/w")}/16 . 
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Use (6.7) to show that a two-dimensional relaxation oscillator 


v= FO u) 
u = wG(v,u) 


at an Andronov-Hopf bifurcation point has 


1 Hg Gu FiGes Lee | 
a= 35 | Faw | en - b+ on. 


[M.S.] A leaky integrate-and-fire model has the same asymptotic firing rate 
(1/ln) as a system near saddle homoclinic orbit bifurcation. Explore the possi- 
bility that integrate-and-fire models describe neurons near such a bifurcation. 


[M.S.] (blue-sky catastrophe) Prove that 
pau, sa a+a", ifz=-+oo, thenz¢ —oo, and yO, 


is the canonical model (see section 8.1.5) for blue-sky catastrophe. This model 
without the reset of y is canonical for the fold limit cycle on homoclinic torus 
bifurcation. The model with the reset x < b+sin y is canonical for the Lukyanov- 
Shilnikov bifurcation of a fold limit cycle with non-central homoclinics (Shilnikov 
and Cymbalyuk 2004, Shilnikov et al. 2005). Here, y is the phase variable on 
the unit circle and a and 0 are bifurcation parameters. 


[M.S.] Define topological equivalence and the notion of a bifurcation for piecewise 
continuous flows. 


[Ph.D.] Use the definition in the exercise above to classify codimension-1 bifur- 
cations in piecewise continuous flows. 


[M.S.] The bifurcation sequence in Fig.6.40 seems to be typical in two-dimensional 
neuronal models. Develop the theory of Bogdanov-Takens bifurcation with a 
global reentrant orbit. 


[Ph.D.] Develop an automated dynamic clamp protocol (Sharp et al. 1993) that 
analyzes bifurcations in neurons in vitro, similar to what AUTO, XPPAUT, and 
MATCONT do in models. 


Chapter 7 


Neuronal Excitability 


Neurons are excitable in the sense that they are typically at rest but can fire spikes in 
response to certain forms of stimulation. What kind of stimulation is needed to fire a 
given neuron? What is the evoked firing pattern? These are the questions concerning 
the neuron’s computational properties, e.g., whether they are integrators or resonators, 
their firing frequency range, the spike latencies (delays), the coexistence of resting and 
spiking states, etc. From the dynamical systems point of view, neurons are excitable 
because they are near a bifurcation from resting to spiking activity. The type of 
bifurcation, and not the ionic currents per se, determines the computational properties 
of neurons. In this chapter we continue our effort to understand the relationship 
between bifurcations of the resting state and the neurocomputational properties of 
excitable systems. 


7.1 Excitability 


A textbook definition of neuronal excitability is that a “subthreshold” synaptic input 
evokes a small graded postsynaptic potential (PSP), while a “superthreshold” input 
evokes a large all-or-none action potential, which is an order of magnitude larger than 
the amplitude of the subthreshold response. Unfortunately, we cannot adopt this 
definition to define excitability of dynamical systems because many systems, including 
some neuronal models discussed in chapter 4, have neither all-or-none action potentials 
nor firing thresholds. Instead, we employ a purely geometrical definition. 

From the geometrical point of view, a dynamical system with a stable equilibrium is 
excitable if there is a large-amplitude piece of trajectory that starts in a small neighbor- 
hood of the equilibrium, leaves the neighborhood, and then returns to the equilibrium, 
as we illustrate in Fig.7.1 (left). 

In the context of neurons, the equilibrium corresponds to the resting state. Because 
it is stable, all trajectories starting in a sufficiently small region of the equilibrium, much 
smaller than the shaded neighborhood in the figure, converge back to the equilibrium. 
Such trajectories correspond to subthreshold PSPs. In contrast, the large trajectory in 
the figure corresponds to firing a spike. Therefore, superthreshold synaptic inputs are 
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spike 


rest rest 


excitable oscillatory 


Figure 7.1: Left: An abstract definition of excitability. There is a spike trajectory that 
starts near a stable equilibrium and returns to it. Right: Excitable systems are near 
bifurcations. A modification of the vector field in the small shaded region can result 
in a periodic trajectory. 


those that push the state of the neuron to or near the beginning of the large trajectory 
(small square in Fig.7.1), thereby initiating the spike. These inputs can be injected 
by an experimenter via an attached electrode, or they can represent the total synaptic 
input from the other neurons in the network, or both. 


7.1.1 Bifurcations 


The definition in Fig.7.1 is quite general, and it does not make any assumptions regard- 
ing the details of the vector field inside or outside of the small shaded neighborhood. 
Let us use the theory presented in chapter 6 to show that such an excitable system is 
near a bifurcation from resting to oscillatory dynamics. 


e Bifurcation of a limit cycle. The vector field in the small shaded neighborhood 
of the equilibrium can be modified slightly so that the spike trajectory enters 
the square and becomes periodic, as in Fig.7.1 (right). That is, the dynamical 
system goes through a bifurcation resulting in the appearance of a limit cycle. 


What happens to the stable equilibrium, denoted as “?” in the figure? Depending 
on the type of the bifurcation of the limit cycle, the equilibrium may disappear or 
may lose stability. This happens when the limit cycle appears via saddle-node on an 
invariant circle or a supercritical Andronov-Hopf bifurcation, respectively. Both cases 
are depicted in Fig.7.2. 
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Figure 7.2: Excitable dynamical systems bifurcate into oscillatory ones either directly 
or indirectly, via bistable systems. 
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Alternatively, the equilibrium may remain stable and coexist with the newly born 
limit cycle, as happens during saddle homoclinic orbit or fold limit cycle bifurcations 
in Fig.7.2. The dynamical system is no longer excitable, but bistable, though many 
scientists still treat bistable systems as excitable. An appropriate synaptic input can 
switch the behavior from resting to spiking and back. Note that we considered only 
bifurcations of a limit cycle so far. 


e Bifurcation of the equilibrium. Suppose the system is bistable, as in Fig.7.2. Since 
the equilibrium is near the cycle, a small modification of the vector field in the 
shaded neighborhood can make it disappear via saddle-node bifurcation, or lose 
stability via subcritical Andronov-Hopf bifurcation. 


In any case, excitable dynamical systems can bifurcate into oscillatory systems either 
directly or indirectly through bistable systems. All these cases are summarized in 
Fig.7.2. 


7.1.2 Hodgkin’s Classification 


As we mentioned in the introduction chapter, the first person to study bifurcation 
mechanisms of excitability (years before mathematicians discovered such bifurcations) 
was Hodgkin (1948), who injected steps of currents of various amplitudes into excitable 
membranes and looked at the resulting spiking behavior. We illustrate his experiments 
in Fig.7.3, using recordings of rat neocortical and brainstem neurons. When the current 
is weak, the neurons are quiescent. When the current is strong, the neurons fire trains 
of action potentials. Depending on the average frequency of such firing, Hodgkin 
identified two major classes of excitability: 


e Class 1 neural excitability. Action potentials can be generated with arbitrarily 
low frequency, depending on the strength of the applied current. 


e Class 2 neural excitability. Action potentials are generated in a certain frequency 
band that is relatively insensitive to changes in the strength of the applied current. 


Class 1 neurons, sometimes called type I neurons, fire with a frequency that may vary 
smoothly over a broad range of about 2 to 100 Hz or even higher. The important 
observation here is that the frequency can be changed tenfold. In contrast, the fre- 
quency band of Class 2 neurons is quite limited, e.g., 150 — 200 Hz, but it can vary 
from neuron to neuron. The exact numbers are not important here. The qualitative 
distinction between the classes noted by Hodgkin is that the frequency-current relation 
(the F-I curve in Fig.7.3, bottom) starts from zero and continuously increases for Class 
1 neurons, but is discontinuous for Class 2 neurons. 

Obviously, the two classes of excitability have different neurocomputational prop- 
erties. Class 1 excitable neurons can smoothly encode the strength of an input, e.g., 
the strength of the applied DC current or the strength of the incoming synaptic bom- 
bardment, into the frequency of their spiking output. Class 2 neurons cannot do that. 
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Figure 7.3: Top: Typical responses of membrane potentials of two neurons to steps of 
DC current of various magnitudes J. Bottom: Corresponding frequency-current (F-I) 
relations are qualitatively different. Shown are recordings of layer 5 pyramidal neurons 
from rat primary visual cortex (left) and mesV neuron from rat brainstem (right). The 
asymptotic frequency is 1000/T.,., where 7. is taken to be the interval between the 
last two spikes in a long spike train. 
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Figure 7.4: Class 3 excitability of a mesV neuron of rat brainstem (contrast with 
Fig.7.3). 
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Figure 7.5: Class 3 excitability of a layer 5 pyramidal neuron of rat visual cortex. The 
inset shows subthreshold oscillations of membrane potential. 


Instead, they can act as threshold elements reporting when the strength of an input is 
above a certain value. Both properties are important in neural computations. 
Hodgkin also observed that axons left in oil or seawater for long periods exhibited 


e Class 3 neural excitability. A single action potential is generated in response to a 
pulse of current. Repetitive (tonic) spiking can be generated only for extremely 
strong injected currents or not at all. 


Two examples of Class 3 excitable systems are depicted in Fig.7.4 and Fig.7.5. The 
mesV neuron in the figure fires a phasic spike at the onset of the pulse of current, and 
then remains quiescent. Even injecting pulses as high as 1000 pA, which result in spike 
trains in another mesV neuron in Fig.7.3, cannot evoke multiple spikes in this neuron. 
Similarly, the pyramidal neuron in Fig.7.5 cannot sustain tonic spiking even when the 
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injected current is ten times stronger than the neuron’s rheobase. Ironically, neurons 
exhibiting such a behavior would most likely be discarded as “sick” or “unhealthy”, 
though the neurons analyzed in the figures looked normal from any other point of view. 
We will study the dynamic mechanism of this class of excitability and show that it may 
have nothing to do with sickness. 

It will shortly be clear that this classification is of limited value except that it 
points to the fact that neurons should be distinguished according not only to ionic 
mechanisms of excitability but also to dynamic mechanisms, in particular to the type 
of bifurcation of the resting state. 


7.1.3. Classes 1 and 2 


Let us consider the strength of the applied current in Hodgkin’s experiments as being 
a bifurcation parameter. Instead of changing the parameter abruptly, as in Fig.7.3, 
we change it slowly in Fig.7.6 (both figures show recordings of the same neurons). In 
section 7.1.5 we explain the fundamental difference between these two protocols. 

When the current ramps up, the resting potential increases until a bifurcation 
occurs, resulting in loss of stability or disappearance of the equilibrium corresponding to 
the resting state, and the neuron activity becomes oscillatory. Note that the pyramidal 
neuron in Fig.7.6 starts to fire with a small frequency, which then increases according 
to the F-I curve in Fig.7.3 (a slower current ramp is needed to span the entire frequency 
range of the F-I curve). In contrast, the brainstem neuron starts to fire with a high 
frequency that remains relatively constant even though the magnitude of the injected 
current increases. 

Among all four codimension-1 bifurcations of equilibrium, discussed in chapter 6 
and mentioned in Fig.7.2, only saddle-node on invariant circle bifurcation results in a 


layer 5 pyramidal cell brainstem mesV cell 
transition 
transition 
20 mV 
-50 mV 
-60 mV 
200 pA 3000 pA 
0 pA OpA 
500 ms 500 ms 


Figure 7.6: As the magnitude of injected DC current increases, the neurons bifurcate 
from resting to repetitive spiking behavior. Shown are recordings of the neurons in 
Fig.7.3. Note that the ratio of the first and last interspike intervals of the pyramidal 
cell is much greater than that of the mesV neuron. 
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Figure 7.7: A Class 3 excitable brainstem mesV neuron does not fire in response to a 
ramp current, even though the injected current is stronger than the one in Fig.7.4. 


limit cycle attractor with arbitrarily small frequency and continuous F-I curve. The 
other three bifurcations result in limit cycle attractors with relatively large frequencies 
and discontinuous F-I curves. Therefore, 


e Class 1 neural excitability corresponds to the resting state disappearing via 
saddle-node on invariant circle bifurcation. 


e Class 2 neural excitability corresponds to the resting state disappearing via 
saddle-node (off invariant circle) bifurcation or losing stability via subcritical 
or supercritical Andronoy-Hopf bifurcations. 


Of course, the resting state can lose stability or disappear via other bifurcations hav- 
ing higher codimension, sometimes leading to counterintuitive results (e.g., Class 1 
excitability near Andronov-Hopf bifurcation; see exercise 6 and section 7.2.11). In this 
chapter we concentrate on the four bifurcations above because they have the lowest 
codimension and hence are the most likely to be seen experimentally. 


7.1.4 Class 3 


In Fig.7.7 we inject a slow ramp current into the Class 3 excitable system. In contrast 
to Fig.7.6, no spiking and no bifurcation occur in this experiment, despite the fact that 
the membrane potential goes all the way to 0 mV. Therefore, 


e Class 3 neural excitability occurs when the resting state remains stable for any 
fixed J in a biophysically relevant range. 


Then why are there single spikes in Fig.7.4? Their existence in the figure and their 
absence in the ramp experiment are related to the phenomenon of accommodation that 
we now describe. 

Let us consider a neuron having a transient Na* current with relatively fast inac- 
tivation. If a sufficiently slow ramp of current is injected, the current has enough time 
to inactivate, and no action potentials can be generated. Such a neuron accommodates 
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V-nullcline 


Figure 7.8: Class 3 excitability in FitzHugh-Nagumo model (4.11, 4.12) with a = 
0.1,6 = 0.01,c = 0. The model fires a single spike for any pulse of current. 


to the slow ramp. In contrast, a quick membrane depolarization due to a strong step 
of current does not give enough time for Na* inactivation, thereby resulting in a spike. 
During the spike, the current inactivates quickly and precludes any further action po- 
tentials. Instead of inactivating the Nat current, we could have used a low-threshold 
persistent K* current, or any other resonant current, to illustrate the phenomenon of 
accommodation. 

From the dynamical systems point of view, slow ramp results in quasi-static dy- 
namics so that all gating variables follow their steady-state values, x = 7.(V), and the 
membrane potential follows its I-V curve. As long as the equilibrium corresponding to 
the resting state is stable, the neuron is at rest. Even global bifurcations resulting in 
the appearance of stable limit cycles do not change that. Only when the equilibrium 
bifurcates (loses stability or disappears), does the neuron change its behavior, e.g., 
jumps to a limit cycle attractor and starts to fire spikes. Class 3 excitable systems do 
not fire in response to slow ramps because the resting state does not bifurcate. 

In contrast, a pulse of current changes the phase portrait in a rather abrupt man- 
ner, as we illustrate in Fig.7.8, using the FitzHugh-Nagumo model with vertical slow 
nullcline. Injecting J shifts the fast nullcline upward. Though no bifurcation can occur 
in the model, and the resting state is stable for any value of J, its location suddenly 
shifts when J jumps. The trajectory from the old equilibrium, (0,0), to the new one 
goes through the right branch of the cubic V-nullcline, thereby resulting in a single 
spike. Since the new equilibrium (0,0.03) is a global attractor and no limit cycles 
exist, periodic spiking cannot be generated. In exercise 7 we explore the relationship 
between Class 3 excitability and Andronov-Hopf bifurcation (note the subthreshold 
oscillations of membrane potential of the pyramidal neuron in Fig.7.5). We see that 
injecting ramps of current is not equivalent to injecting pulses of current. The system 
goes through a bifurcation of the equilibrium in the former, but may bypass it and 
jump somewhere else in the latter. 
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Figure 7.9: The difference between ramp, step, and shock stimulations is in the resetting 
of initial condition. 


7.1.5 Ramps, Steps, and Shocks 


In Fig.7.9 we elaborate the differences among injecting slow ramps, steps, and shocks 
(i.e., brief pulses) of current. In the first two cases the magnitude of the injected 
current changes from Jp) to J,, while in the third case the current is [, except for the 
infinitesimally brief moment when it has an infinitely large strength. In all three cases 
the dynamics of the model can be understood via analysis of its phase portrait at 
I = 1,. The key difference among the stimulation protocols is how they reset the 
initial condition. 

At the beginning of the slow ramp in Fig.7.9a, the state of the neuron is at the 
stable equilibrium. As the current slowly increases, the equilibrium slowly moves, and 
the trajectory follows it. When the current reaches J = J,, the trajectory is at the new 
equilibrium, so no response is evoked because the equilibrium is stable. In contrast, 
when the current is stepped from Jp to J, in Fig.7.9b, the location of the equilibrium 
changes instantaneously, but the membrane potential and the gating variables do not 
have time to catch up. To understand the response of the model to the step, we need 
to consider its dynamics at J = J, with the initial condition set to the location of 
the old equilibrium (marked by the white square in the figure). Such a step evokes a 
spike response even though the new equilibrium is stable. Finally, shocking the neuron 
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Figure 7.10: The INap»p+/«-model undergoes subcritical Andronov- Hopf bifurcation, yet 
can exhibit low-frequency firing when steps (but not ramps) of current are injected. 
Parameters: G = 1, 7 = 0, Ey, = —66.2, g, = 2, dns — 5; Ge = 4.5; Mial(V) has 
Vio = —30 and k = 10, no (V) has Viso = —34 and k = 13, and 7(V) = 1, Ena = 60 
mV and Ex = —90 mV. The shaded region is the attraction domain of the resting 
state. The inset shows a distorted drawing of the phase portrait. 


results in an instantaneous increase of its membrane potential to a new value. (As an 
exercise, prove that the magnitude of the increase equals the product of pulse width and 
pulse height divided by the membrane capacitance.) This shifts the initial condition 
horizontally to a new point, marked by the white square in Fig.7.9c, and results in a 
spike response. 

Now, let us revisit the Hodgkin experiments and demonstrate the fundamental 
difference between the stimulation protocols. In Fig.7.10a, b, and c we simulate the 
Ivap+/«-model and show that it is Class 2 excitable in response to ramps of current 
but Class 1 excitable in response to steps of current. The apparent contradiction is 
resolved in Fig.7.10d and e, where we consider the model’s phase portraits. Notice 
the coexistence of the resting state and a limit cycle attractor. The resting state 
loses stability via subcritical Andronov-Hopf bifurcation at J = 5.25, so the emerging 
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Figure 7.11: Coexistence of stable equilibrium and spiking limit cycle attractor in 
the InaptJ«-model. Left: The resting state is about to disappear via saddle-node 
bifurcation. Right: The resting state is about to lose stability via subcritical Andronov- 
Hopf bifurcation. Right (left) arrows denote the location and the direction of an 
excitatory (inhibitory) pulse that switches spiking behavior to resting behavior. 


spiking has non-zero frequency at I & 5.25. However, injecting steps of current results 
in transitions to the limit cycle even before the resting state loses its stability. The 
limit cycle in the model appears via saddle homoclinic orbit bifurcation at I + 3.8866, 
and its period is quite large, resulting in the Class 1 response to steps of current. 
The F-I curves for homoclinic bifurcations have logarithmic scaling, so small-frequency 
oscillations are difficult to catch numerically, let alone experimentally. 

The surprising discrepancy in Fig.7.10a occurs because the resting state of the 
INap+/k-model is near the Bogdanoy-Takens bifurcation (i.e., the model is near a 
transition from resonator to integrator). Such a bifurcation was recorded, though 
indirectly, in some neocortical pyramidal neurons, as we will show later in this chapter 
and in chapter 8. Another surprising example of Andronov-Hopf bifurcation with Class 
1 excitability is presented in exercise 6. To avoid such surprises, we adopt the ramp 
definition of excitability throughout the book. 


7.1.6 Bistability 


When transition from the resting to the spiking state occurs via saddle-node (off in- 
variant circle) or subcritical Andronov-Hopf bifurcation, there is a coexistence of a 
stable equilibrium and a stable limit cycle attractor just before the bifurcation, as we 
illustrate in Fig.7.11. We refer to such systems as bistable. They have a remarkable 
neurocomputational property: bistable systems can be switched from one state to the 
other by an appropriately timed brief stimulus. Rinzel (1978) predicted such a be- 
havior in the Hodgkin-Huxley model, and then bistability and hysteresis were found 
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experimentally in the squid axon (Guttman et al. 1980). What was really surprising 
for many neuroscientists is that neurons can be switched from repetitive spiking to 
resting by brief depolarizing shock stimuli. 


This phenomenon is illustrated in Fig.7.11. Each shaded area in the figure denotes 
the attraction domain of a spiking limit cycle attractor. Obviously, the state of the 
resting neuron must be pushed into the shaded area to initiate periodic spiking. Sim- 
ilarly, the state of the periodically spiking neuron must be pushed out of the shaded 
area to stop the spiking. As the arrows in the figure indicate, both excitatory and in- 
hibitory stimuli can do that, depending on their timing relative to the phase of spiking 
oscillation. This protocol can be used to test bistability experimentally. (As an exer- 
cise, use geometrical and electrophysiological arguments to explain why a system with 
high-threshold slow persistent inward current can be bistable but cannot be switched 
from one mode to another by brief pulses of current.) Bistable behavior reveals it- 
self indirectly when a neuron is kept close to the bifurcation, e.g., when the injected 
DC current is just below the rheobase. Noisy perturbations can switch the neuron 
from resting to spiking state, thereby creating an irregular spike train consisting of 
short bursts of spikes. Such stuttering spiking have been observed in many neurons, 
including some regular spiking (RS) and fast spiking (FS) neocortical neurons, as we 
discuss in chapter 8. The mean firing frequency during stuttering is proportional to the 
amplitude of the injected current and it can be quite low even for a Class 2 excitable 
system, as we illustrate in Fig.7.12. Thus, caution should be used when experimentally 
determining the class of excitability; only spike trains with regular interspike periods 
should be accepted to measure the F-I relations. 
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Figure 7.13: (a) The frequency of emerging oscillations at the transition “resting > 
spiking” defines the class of excitability. (b) The frequency of disappearing oscillations 
at the transition “spiking — resting” defines the class of spiking. (c) The Ina ptJk- 
model with high-threshold K* current exhibits class 2 excitability but class 1 spiking. 
Its F-I curve has a hysteresis. 


7.1.7 Class 1 and 2 Spiking 


The class of excitability is determined by the frequency of emerging oscillations at 
the transition “resting — spiking’, as in Fig.7.13a. Let us look at the frequency 
of disappearing oscillations at the transition “spiking — resting”. To induce such a 
transition, we inject a strong pulse of DC current of slowly decreasing amplitude, as in 
Fig.7.13b. Similarly to the Hodgkin classification of excitability, we say that a neuron 
has Class 1 spiking if the frequency-current (F-I) curve at the transition “spiking > 
resting” decreases to zero, as in Fig.7.13c, and Class 2 spiking if it stops at a certain 
non-zero value. 

The class of excitability coincides with the class of spiking when the transitions 
“resting <> spiking” occur via saddle-node on invariant circle bifurcation or supercrit- 
ical Andronov-Hopf bifurcation. Indeed, if the current ramps are sufficiently slow, the 
neuron as a dynamical system goes through the same bifurcation, but in the opposite 
direction. The classes may differ when the bifurcation is of the saddle-node (off invari- 
ant circle) type or the subcritical Andronov-Hopf type because of the bistability of the 
resting and spiking states. Such a bistability results in the hysteresis behavior of the 
system when the injected current J increases and decreases slowly, which may result 
in the hysteresis of the F-I curve. For example, the transition “resting — spiking” in 
Fig.7.13a occurs via saddle-node bifurcation at J = 4.51, and the frequency of spiking 
equals the frequency of the limit cycle attractor, which is non-zero at this value of J. 
Decreasing J results in the transition “spiking — resting” via the saddle homoclinic 
orbit bifurcation in Fig.7.13b, and in the oscillations with zero frequency at J = 3.08. 
Thus, the F-I behavior of the model in this figure (and in Fig.7.10) exhibits Class 2 
excitability but Class 1 spiking. Because of the logarithmic scaling of the F-I curve 
at the saddle homoclinic bifurcation (see section 6.2.4), experimentally estimating the 
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zero value of the F-I curves is challenging. 

Interestingly, steps of injected DC current, as in Fig.7.10c, induce the transition 
“resting — spiking”. But because the model in the figure is near a codimension-2 
Bogdanov-Takens bifurcation, the steps test the frequency of the limit cycle attractor 
at the bifurcation “spiking — resting”, as in Fig.7.10e; that is, they test the class of 
spiking! The F-I curve in response to steps in the figure is the same as the F-I curve 
in response to a slowly decreasing current ramp. (As an exercise, explain why this is 
true for Fig.7.10 but not for Fig.7.13.) 


To summarize, we define the class of excitability according to the frequency of 
emerging spiking of a neuron in response to a slowly increasing current ramp. The class 
of excitability corresponds to a bifurcation of the resting state (equilibrium) resulting 
in the transition “resting — spiking”. We define the class of spiking according to the 
frequency of disappearing spiking of a neuron in response to a slowly decreasing current 
ramp. The class of spiking corresponds to the bifurcation of the limit cycle, resulting 
in the transition “spiking — resting”. Stimulating a neuron with ramps (and pulses) is 
the first step in exploring the bifurcations in the neuron dynamics. Combined with the 
test for the existence of subthreshold oscillations of the membrane potential, it tells 
whether the neuron is an integrator or a resonator, and whether it is monostable or 
bistable, as we discuss next. 


7.2 Integrators vs. Resonators 


In this book we classify excitable systems based on two features: the coexistence of 
resting and spiking states and the existence of subthreshold oscillations. The former 
feature divides all systems into monostable and bistable. The latter feature divides 
all systems into integrators (no oscillations) and resonators. These features uniquely 
determine the type of bifurcation of the resting state, as we summarize in Fig.7.14. 
For example, a bistable integrator corresponds to a saddle-node bifurcation, whereas 
monostable resonator corresponds to a supercritical Andronov-Hopf bifurcation. Inte- 
grators and resonators have drastically different neurocomputational properties, sum- 
marized in Fig.7.15 and discussed next (the I-V curves are discussed in chapter 6). 
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Figure 7.14: Classification of neurons into 
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Figure 7.15: Summary of neurocomputational properties. 


7.2.1 Fast Subthreshold Oscillations 


According to the definition, resonators have oscillatory potentials, whereas integra- 
tors do not. This feature is so important that many of the other neuronal properties 
discussed later are mere consequences of the existence or absence of such oscillations. 

Fast subthreshold oscillations, as in Fig.7.16, are typically due to a fast low- 
threshold persistent K* current. At rest, there is a balance of all inward currents 
and this partially activated Kt current. A brief depolarization further activates the 
K* current and results in fast afterhyperpolarization. While the cell is hyperpolarized, 
the current deactivates below its steady-state level, the balance is shifted toward the 
inward currents, and the membrane potential depolarizes again. And so on. 

The existence of fast subthreshold oscillatory potentials is a distinguishable feature 
of neurons near an Andronov-Hopf bifurcation. Indeed, the resting state of such a 
neuron is a stable focus. When it is stimulated by a brief synaptic input or an injected 
pulse of current, the state of the system deviates from the focus equilibrium, then re- 
turns to the equilibrium along a spiral trajectory, as depicted in Fig.7.16 (top), thereby 
producing a damped oscillation. The frequency of such an oscillation is the imaginary 
part of the complex-conjugate eigenvalues at the equilibrium (see section 6.1.3), and it 
can be as large as 200 Hz in mammalian neurons. 


Excitability 


damped oscillations 


K+ activation, n 
o 9 
[op} foe) 


o 
A 


oS 
ho 


0 1 
-80 -60 


brainstem (mes V neurons) 


-40 -20 
membrane potential, V (mV) 


0 
Hodgkin-Huxley model 


12.5 ms 


| 1 mv 


ee ee 


sustained noisy oscillations 


brainstem (mes V neurons) 


-40 mV 
10 ms 
1 mV | 

-47 mV 


mitral cells in olfactory bulb 


PGE RPS -59mV _ 

GaP OS “62 mV . 

pW entrar, “65 mV 
20 ms 


mammalian cortical layer 4 cell 


| 10 mv 100 ms 


VA Na, 
NN el nes 68 mV 


thalamocortical neurons 


Wael nad an -43 mV 
Dr i ae Anverwhea wr -46 mV 


ee  enetnnrnnnneennrannnotn BG mV 


200 ms 


10 mV 


Figure 7.16: Examples of fast damped (top) and sustained (bottom) subthreshold 
oscillations of membrane potential in neurons and their voltage dependence. (Modified 
from Izhikevich et al. 2003). 
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In exercise 3 we prove that noise can make such oscillations sustained. While the 
state of the system is perturbed and returns to the focus equilibrium, another strong 
random perturbation may push it away from the equilibrium, thereby starting a new 
damped oscillation. As a result, persistent noisy perturbations create a random se- 
quence of damped oscillations and do not let the neuron rest. The membrane potential 
of such a neuron exhibits noisy sustained oscillations of small amplitude, depicted in 
Fig.7.16 and discussed in section 6.1.4. 

Injected DC current or background synaptic noise increases the resting potential, 
changes its eigenvalues, and hence changes the frequency and amplitude of noisy oscil- 
lations. Fig.7.16 depicts typical cases when the frequency and the amplitude increase 
as the resting state becomes more depolarized. 

One should be careful to distinguish fast and slow subthreshold oscillations of mem- 
brane potential. Fast oscillations, as in Fig.7.16, are those having a period comparable 
with the membrane time constant or with the period of repetitive spiking. In con- 
trast, some neurons found in entorhinal cortex, inferior olive, hippocampus, thalamus, 
and many other brain regions can exhibit slow subthreshold oscillations with a pe- 
riod of 100 ms and more. These oscillations reflect the interplay between fast and 
slow membrane currents, such as J, or [7, and may be irrelevant to the bifurcation 
mechanism of excitability. We will discuss this issue in detail in section 7.3.3 and in 
chapter 9. Amazingly, such neurons still possess many neurocomputational proper- 
ties of resonators, such as frequency preference and rebound spiking, but exhibit these 
properties on a slower time scale. 


7.2.2 Frequency Preference and Resonance 


A standard experimental procedure to test the propensity of a neuron to subthreshold 
oscillations is to stimulate it with a sinusoidal current having slowly increasing fre- 
quency (called a zap current), as in Fig.7.17. The amplitude of the evoked oscillations 
of the membrane potential, normalized by the amplitude of the stimulating oscilla- 
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Figure 7.17: Response of the mesV neuron to injected zap current sweeping through a 
range of frequencies. Integrators and resonators have different responses. 
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Figure 7.18: Responses of integrators (top) and resonators (bottom) to input pulses 
having various inter-pulse periods. 


tory current, is called the neuronal impedance — a frequency domain extension of the 
concept of resistance. The impedance profile of integrators is decreasing while that 
of resonators has a peak corresponding to the frequency of subthreshold oscillations, 
around 140 Hz in the mesV neuron in the figure. Thus, integrators act as low-pass 
filters while resonators act as band-pass filters to periodic signals. 

Instead of sinusoidal stimulation, consider more biological stimulation with pulses 
of current simulating synaptic bombardment. The response of any neuron to input 
pulses depends on the frequency content of these pulses. In Fig.7.18 we use triplets 
with various inter-pulse periods to illustrate the issue. The pulses may arrive from 
three different presynaptic neurons or from a single presynaptic neuron firing short 
bursts. 

In Fig.7.18 (top) we show that integrators prefer high-frequency inputs. The first 
pulse in each triplet evokes a postsynaptic potential (PSP) that decays exponentially. 
The PSP evoked by the second pulse adds to the first one, and so on. The dependence 
of the combined PSP amplitude on the inter-pulse period is shown in Fig.7.19. Appar- 
ently, the integrator acts as a coincidence detector because it is most sensitive to the 
pulses arriving simultaneously. 

Resonators also can detect coincidences, as one can see in Fig.7.19. In addition, they 
can detect resonant inputs. Indeed, the first pulse in each triplet in Fig.7.18 (bottom), 
evokes a damped oscillation of the membrane potential, which results in an oscillation 
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Figure 7.19: Dependence of combined PSP amplitude on the inter-pulse period; see 
Fig.7.18. 


of the firing probability. The natural period of such an oscillation is around 9 ms for 
the mesencephalic V neuron used in the figure. The effect of the second pulse depends 
on its timing relative to the first pulse: if the interval between the pulses is near the 
natural period, which is 10 ms in Fig.7.18 and Fig.7.20, the second pulse arrives during 
the rising phase of oscillation, and it increases the amplitude of oscillation even further. 
In this case the effects of the pulses add up. The third pulse increases the amplitude 
of oscillation even further, thereby increasing the probability of an action potential, as 
in Fig.7.20. 
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Figure 7.20: Experimental observations of selective response to a resonant (10 ms 
interspike period) burst in mesencephalic V neurons in brainstem having subthreshold 
membrane oscillations with a natural period around 9 ms; see also Fig.7.18. Three 
consecutive voltage traces are shown to demonstrate some variability of the result. 
(Modified from Izhikevich et al. 2003). 
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Figure 7.21: Experimental observations of selective response to inhibitory resonant 
burst in mesencephalic V neurons in brainstem having oscillatory potentials with the 
natural period around 9 ms. (Modified from Izhikevich et al. 2003). 


If the interval between pulses is near half the natural period, e.g., 5 ms in Fig.7.18 
and Fig.7.20, the second pulse arrives during the falling phase of oscillation, and it 
leads to a decrease in oscillation amplitude. The spikes effectively cancel each other in 
this case. Similarly, the spikes cancel each other when the interpulse period is 15 ms, 
which is 60 percent greater than the natural period. The same phenomenon occurs 
for inhibitory synapses, as we illustrate in Fig.7.21. Here the second pulse increases 
(decreases) the amplitude of oscillation if it arrives during the falling (rising) phase. 

We study the mechanism of such frequency preference in exercise 4, and present its 
geometrical illustration in Fig.7.22. There, we depict a projection of the phase portrait 
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Figure 7.22: (Left) Projection of trajectories of the Hodgkin-Huxley model on a plane. 
(Right) Phase portrait and typical trajectories during resonant and non-resonant re- 
sponse of the model to excitatory and inhibitory doublets of spikes. (Modified from 
Izhikevich 2000a). 
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Figure 7.23: Selective communication via bursts. Neuron A sends bursts of spikes to 
neurons B and C, which have different natural periods (12 ms and 18 ms, respectively; 
both are simulations of the Hodgkin-Huxley model). As a result of changing the in- 
terspike frequency, neuron A can selectively affect either B or C without changing the 
efficacy of synapses. (Modified from Izhikevich 2002). 


of the Hodgkin-Huxley model having a stable focus equilibrium. The model does not 
have a true threshold, as we discuss in section 7.2.4. To fire a spike, a perturbation 
must push the state of the model beyond the shaded figure that is bounded by two 
trajectories, one of which corresponds to a small postsynaptic potential (PSP), while 
the other corresponds to a spike. 

Figure 7.22 (right) depicts responses of the model to pairs of pulses, called doublets. 
Pulse 1 in the excitatory doublet shifts the membrane potential from the equilibrium 
to the right, thereby initiating a subthreshold oscillation. The effect of pulse 2 depends 
on its timing: if it arrives when the trajectory finishes one full rotation around the 
equilibrium, it pushes the voltage variable even more to the right, beyond the shaded 
area into the spiking zone, and the neuron fires an action potential. In contrast, if 
it arrives too soon, the trajectory does not finish the rotation, and it is still to the 
left of the equilibrium. In this case, pulse 2 pushes the state of the model closer to 
the equilibrium, thereby canceling the effect of pulse 1. Similarly, the effect of an 
inhibitory doublet depends on the interspike period between the inhibitory pulses. If 
the interpulse period is near the natural period of damped oscillations, pulse 2 arrives 
when the trajectory finishes one full rotation, and it adds to pulse 1, thereby firing the 
neuron. If it arrives too soon or too late, it cancels the effect of pulse 1. 

Quite often, the frequency of subthreshold oscillations depends on their amplitudes, 
for instance, oscillations in the Hodgkin-Huxley model slow down as they become larger. 
In this case, the optimal input is a resonant burst with a slowly decreasing (adapting) 
interspike frequency. We will see many examples of such bursts in chapter 9. 
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The fact that resonator neurons prefer inputs with “resonant” frequencies is not 
interesting by itself. What makes it interesting is the observation that the same input 
can be resonant for one neuron and non-resonant for another, depending on their 
natural periods. For example, in Fig.7.23 neurons B and C have different periods of 
subthreshold oscillations: 12 and 18 ms, respectively. By sending a burst of spikes with 
an interspike interval of 12 ms, neuron A can elicit a response in neuron B, but not in 
neuron C. Similarly, the burst with an interspike interval of 18 ms elicits a response in 
neuron C, but not in neuron B. Thus, neuron A can selectively affect either neuron B 
or neuron C merely by changing the intra-burst (interspike within a burst) frequency 
without changing the efficacy of synaptic connections. In contrast, integrators do not 
have this property. 


7.2.3 Frequency Preference in Vivo 


Figures 7.20 and 7.21 convincingly demonstrate the essence of frequency preference 
and resonance phenomenon in vitro, when the neuron is quiescent and “waiting” for 
the resonant burst to come. What if the neuron is under a constant bombardment of 
synaptic input, as happens in vivo, firing ten or so spikes per second? Would it be able 
to tell the difference between the resonant and non-resonant inputs? 

To address this question, we performed a frozen-noise experiment pioneered by 
Bryant and Segundo (1976) and depicted in Fig.7.24. We generated a noisy signal 
(frozen noise in Fig.7.24a) and saved it into the memory of the program that injects 
current into a neuron. Then we injected the stored signal into the neuron 50 times to 
see how reliable its spike response was. Despite the in vivo-like activity in Fig.7.24b, 
the spike raster in Fig.7.24c shows vertical clusters indicating that the neuron prefers 
to fire at certain “scheduled” moments of time corresponding to certain features of the 
frozen noise input. 

In Fig.7.24d—g, we added bursts of three spikes to the frozen noise. The amplitudes 
of the bursts were constant (less than 10 percent of the frozen noise amplitude), but 
the interspike periods were different. The idea was to see whether the response of the 
neuron would be any different when the burst period was near the neuronal intrinsic 
period of 6.7 ms (see the inset in Fig.7.24b). As one would expect, the non-resonant 
bursts with 4 ms and 9 ms periods remained undetected by the neuron, since the spike 
rasters in Fig.7.24d and g are essentially the same as in Fig.7.24c. The resonant burst 
with 7 ms period in Fig.7.24f produced the most significant deviation from Fig.7.24c 
(marked by the black arrow), indicating that the neuron is most sensitive to the reso- 
nant input. Typically, the resonant burst does not make the neuron fire extra spikes, 
but only changes the timing of “scheduled” spikes. Injecting resonant bursts at dif- 
ferent moments results in other interesting phenomena, such as extra spikes and the 
omission of “scheduled” spikes (not shown here), or no effect at all. Finally, there is a 
subtle but noticeable effect of the resonant (7 ms) and nearly resonant (6 ms) bursts 
even 100 ms after the stimulation (white arrows in the figure), for which we have no 
explanation. 
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Figure 7.24: Frozen noise experiments demonstrate frequency preference and resonance 
to embedded bursts. (a) A random signal (frozen noise) is injected into a neuron (b) 
in vitro to simulate in vivo conditions. The neuron responds with some spike-timing 
variability, depicted in (c). (d-g) Burst input is added to the frozen noise. Note that 
the neuron is most sensitive to the input having the resonant period 7 ms, which is 
near the period of subthreshold oscillation (6.7 ms). Shown are in vitro responses of 
mesencephalic V neuron of rat brainstem recorded by the author, Niraj S. Desai, and 
Betsy C. Walcott. The order of stimulation was the first line of c, d, e, f, g, then the 
second line of c, d, e, f, g, then the third line, and so on, to avoid slow artifacts. 


7.2.4 Thresholds and Action Potentials 


A common misconception is that all neurons have firing thresholds. Moreover, great 
effort has been made to determine such thresholds experimentally. Typically, a neu- 
ron is stimulated with brief current pulses of various amplitudes to elicit various de- 
grees of depolarization of the membrane potential, as we illustrate in Fig.7.25 using 
the Hodgkin-Huxley model. Small “subthreshold” depolarizations decay while large 
“superthreshold” or “suprathreshold” depolarizations result in action potentials. The 
maximal value of the subthreshold depolarization is taken to be the firing threshold 
value for that neuron. Indeed, the neuron will fire a spike if depolarized just above 
that value. 
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Figure 7.26: Variable-size action potentials in squid giant axon and revised Hodgkin- 
Huxley model (Clay 1998) in response to brief steps of currents of variable magnitudes. 
(Data provided by John Clay.) 


The notion of a firing threshold is simple and attractive, especially when teaching 
neuroscience to undergraduates. Everybody, including the author of this book, uses 
it to describe neuronal properties. Unfortunately, it is wrong. First, the problem is 
in the definition of an action potential. Are the two dashed curves in Fig.7.26 action 
potentials? What about a curve in between (not shown in the figure)? Suppose we 
define an action potential to be any deviation from the resting potential, say by 20 
mV. Is the concept of a firing threshold well defined in this case? Unfortunately, the 
answer is still NO. 


The membrane potential value that separates subthreshold depolarizations from 
action potentials (whatever the definition of an action potential is) depends on the 
prior activity of the neuron. For example, if a neuron having transient Na* current 
has just fired an action potential, the current is partially inactivated, and a subsequent 
depolarization above the firing threshold may not evoke another action potential. Con- 
versely, if the neuron was briefly hyperpolarized and then released from hyperpolariza- 
tion, it could fire a rebound postinhibitory spike, as we discuss later in this chapter 
(see Fig.7.29). Apparently, releasing from hyperpolarization does not qualify as a su- 
perthreshold stimulation. Why, then, did the neuron fire? 
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Figure 7.27: Threshold manifolds and sets in the [ya,+Jx-model. Parameters in (a) 
are as in Fig.4.la, and in (b), (c), and (d) as in Fig.6.16 with J = 45 (b) and J = 42 
(c and d). 


7.2.5 Threshold manifolds 


The problem of formulating a mathematical definition of firing thresholds was first 
tackled by FitzHugh (1955). Using geometrical analysis of neural models, he noticed 
that thresholds, if they exist, are never numbers but manifolds, e.g., curves in two- 
dimensional systems. We illustrate his concept in Fig.7.27, using phase plane analysis 
of the Ina p+Jk-model. 

Integrators do have well-defined threshold manifolds. Since an integrator neuron is 
near a saddle-node bifurcation, whether on or off an invariant circle, there is a saddle 
point with its stable manifold (see Fig.7.27a). This manifold separates two regions of 
the phase space, and for this reason is often called a separatriz. Depending on the prior 
activity of the neuron and the size of the input, its state can end up in the shaded 
area and generate a subthreshold potential, or in the white area and generate an action 
potential. An intermediate-size input cannot reduce the size of the action potential; it 
can only delay its occurrence. In the extreme case, a perturbation can put the state 
vector precisely on the threshold manifold, and the system converges to the saddle, at 
least in theory. Since the saddle is unstable, small noise present in neurons pushes the 
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state either to the left or to the right, resulting in either a long subthreshold potential 
or a large-amplitude spike with a long latency, as we discuss in section 7.2.9 and show 
in Fig.7.34. Finally, note that a neuron has a single threshold value of membrane 
potential only when its threshold manifold is a straight line orthogonal to the V axis. 

Resonators may or may not have well-defined threshold manifolds, depending on 
the type of bifurcation. Consider a resonator neuron in the bistable regime; that is, 
sufficiently near a subcritical Andronoy-Hopf bifurcation with an unstable limit cycle 
separating the resting and the spiking states, as in Fig.7.27b. Such an unstable cycle 
acts as a threshold manifold. Any perturbation that leaves the state of the neuron 
inside the attraction domain of the resting state, which is the shaded region bounded 
by the unstable cycle, results in subthreshold potentials. Any perturbation that pushes 
the state of the neuron outside the shaded region results in an action potential. In the 
extreme case, a perturbation may put the state right on the unstable limit cycle. Then, 
the neuron exhibits unstable ”threshold” oscillations, at least in theory. In practice, 
such oscillations cannot be sustained because of noise, and they will either subside or 
result in spikes. 

The bistable regime near subcritical Andronov-Hopf bifurcation is the only case in 
which a resonator can have a well-defined threshold manifold. In all other cases, includ- 
ing the supercritical Andronov-Hopf bifurcation, resonators do not have well-defined 
thresholds. We illustrate this in Fig.7.27c. A small deviation from the resting state 
produces a trajectory corresponding to a “subthreshold” potential. A large deviation 
produces a trajectory corresponding to an action potential. We refer to the shaded 
region between the two trajectories as a threshold set. It consists of trajectories cor- 
responding to partial-amplitude action potentials, such as those in Fig.7.26. No single 
curve separates small potentials from action potentials, so there is no well-defined 
threshold manifold. 

FitzHugh (1955) noticed that the threshold set can be quite thin in some models, 
including the Hodgkin-Huxley model. In particular, the difference between the trajec- 
tories corresponding to small potentials and action potentials can be as small as 0.0001 
mV, which is smaller than the noisy fluctuations of the membrane potential. Thus, 
to observe an intermediate-amplitude spike in such models, one needs to simulate the 
models with accuracy beyond the limits of uncertainty that appear when the physical 
interpretation of the model is considered. As a result, for any practical purpose such 
models exhibit all-or-none behavior, with the threshold set looking like a threshold 
manifold. FitzHugh referred to this as being a quasi-threshold phenomenon. 

Quasi-thresholds are related to the special canard trajectory depicted in Fig.7.27d. 
The trajectory follows the unstable branch of the cubic nullcline all the way to the right 
knee point P. The flow near the trajectory is highly unstable; any small perturbation 
pushes the state of the system to the left or to the right, resulting in a “subthreshold” 
or “superthreshold” response. The solutions depicted in Fig.7.26 (right) try to follow 
such a trajectory. An easy way to compute the trajectory in two-dimensional relaxation 
oscillators is to start with the point P and integrate the system backward (t — —oo). 
We discuss canard solutions in detail in section 6.3.4. 
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Figure 7.28: Integrators have a well-defined rheobase current, while resonators may 
not. 


7.2.6 Rheobase 


The neuronal rheobase, that is, the minimal amplitude of a current of infinite duration 
that makes the neuron fire, measures the “current threshold” of the neuron. Inte- 
grators have a well-defined rheobase, while resonators may not. To see this, consider 
an integrator neuron in Fig.7.28a receiving a current step that instantly changes its 
phase portrait. In particular, the current moves the equilibrium from the old location 
corresponding to J = 0 (white square in the figure) to a new location (black circle). 
Whether the neuron fires or not depends on the location of the old equilibrium relative 
to the stable manifold to the saddle, which plays the role of the new threshold. In 
case A the neuron does not fire; in case B it fires even though the resting state is still 
stable. The neuronal rheobase is the amplitude of the current J that puts the threshold 
exactly on the location of the old equilibrium. Such a value of J always exists, and it 
often corresponds to the saddle-node bifurcation value. Note that the rheobase current 
results in a spike with infinite latency, at least theoretically. 

A resonator neuron may not have a well-defined rheobase simply because it may 
not have well-defined threshold. Indeed, the dotted line in Fig.7.28b may correspond to 
a subthreshold or superthreshold response, depending on where it is in the threshold 
set. Stimulating such a neuron with “rheobase” current produces spikes with finite 
latencies but partial amplitudes. A bistable resonator (near subcritical Andronov-Hopf 
bifurcation) may have a well-defined rheobase because it has a well-defined threshold 
— the small-amplitude unstable limit cycle. 


7.2.7  Postinhibitory Spike 


Prolonged injection of a hyperpolarizing current and then sudden release from hyper- 
polarization can produce a rebound postinhibitory response in many neurons. The 
hyperpolarizing current is often called an anodal current, release from the hyperpolar- 
ization is called anodal break, and rebound spiking is called anodal break excitation 


Excitability 243 


10 mV 
10 ms 
-45 mV Figure 7.29: Rebound spikes in response to 
a brief hyperpolarizing pulse in a brainstem 
0 pA | mesV neuron having fast subthreshold oscil- 
-100 pA lations of membrane potential. 


(FitzHugh 1976). Note that firing of a neuron follows a sudden increase of injected 
current, whether it is a positive step or a release from a negative step. 

Often, postinhibitory responses are caused by the “hyperpolarization-activated” h- 
current, which slowly builds up and, upon termination of the hyperpolarization, drives 
the membrane potential over the threshold manifold (or threshold set). Alternatively, 
the rebound response can be caused by slow deinactivation of Nat or Ca?* currents, 
or slow deactivation of a Kt current that is partially activated at rest and prevents 
firing. In any case, such a rebound response relies on slow currents and long or strong 
hyperpolarizing steps; it does not depend on the bifurcation mechanism of excitability, 
and it can occur in integrators or resonators. 

Some neurons can exhibit rebound spikes after short and relatively weak hyper- 
polarizing currents, as we illustrate in Fig.7.29. The negative pulse deactivates a fast 
low-threshold resonant current (e.g., K* current) that is partially activated at rest. 
Upon release from the hyperpolarization, there is a deficit of the outward current and 
the net membrane current results in rebound depolarization and possibly a spike. Such 
a response occurs on the fast time scale, and it does depend on the bifurcation mech- 
anism of excitability. 

In Fig.7.30 we show why integrators cannot fire rebound spikes in response to short 
stimulation, while resonators typically can. A brief excitatory pulse of current depo- 
larizes the membrane and brings it closer to the threshold manifold, as in Fig.7.30a. 
Consequently, an inhibitory pulse hyperpolarizes the membrane and increases the dis- 
tance to the threshold manifold. The dynamics of such a neuron is consistent with the 
intuition that excitation facilitates spiking and inhibition prevents it. 

Contrary to our intuition, however, inhibition can also facilitate spiking in resonator 
neurons because the threshold set may wrap around the resting state, as in Fig.7.30b. 
A sufficiently strong inhibitory pulse can push the state of the neuron beyond the 
threshold set, thereby evoking a rebound action potential. If the inhibitory pulse is 
not strong, it still can have an excitatory effect, since it brings the state of the system 
closer to the threshold set. For example, it can enhance the effect of subsequent 
excitatory pulses, as we illustrate in Fig.7.31. The excitatory pulse here is subthreshold 
if applied alone. However, it becomes superthreshold if preceded by an inhibitory pulse. 
The timing of pulses is important here, as we discussed in section 7.2.2. John Rinzel 
suggested calling this phenomenon a postinhibitory facilitation. 
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Figure 7.30: Direction of excitatory and inhibitory input in integrators (a) and res- 
onators (b). 
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Figure 7.31: Postinhibitory facilitation: A subthreshold excitatory pulse can become 
superthreshold if it is preceded by an inhibitory pulse. 


7.2.8 Inhibition-Induced Spiking 

In Fig.7.32 (left) we use the [y,4-model introduced in chapter 5 to illustrate an inter- 
esting property of some resonators: inhibition-induced spiking. Recall that the model 
consists of an Ohmic leak current and a transient Nat current with instantaneous ac- 
tivation and relatively slow inactivation kinetics. It can generate action potentials due 
to the interplay between the amplifying gate m and the resonant gate h. 

We widened the activation function h,(V) so that the Nat current is largely in- 
activated at the resting state; see the inset in Fig.7.32 (right). Indeed, h = 0.27 when 
I =0. Even though such a system is excitable, it cannot fire repetitive action poten- 
tials when a positive step of current (e.g., J = 10) is injected. Depolarization produced 
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Figure 7.32: Inhibition-induced spiking in the Jy,-model. Parameters are the same 
as in Fig.5.6b, except giecak = 1.5 and m.(V) has k = 27. 
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by the injected current inactivates the Nat current so much that no repetitive spikes 
are possible. Such a system is Class 3 excitable. 

Remarkably, injection of a negative step of current (e.g., J = —15 in the figure) 
results in a periodic train of action potentials! How is it possible? Inhibition-induced 
spiking or bursting is possible in neurons having slow h-current or T-current, such as 
the thalamocortical relay neurons. (We discuss these and other examples in the next 
chapter.) The Jxat-model does not have such currents, yet it can fire in response to 
inhibition. 

Figure 7.33 summarizes the ionic mechanism of inhibition-induced spiking. The 
resting state in the model corresponds to the balance of the outward leak current and 
a partially activated, partially inactivated inward Na* current. When the membrane 
potential is hyperpolarized by the negative injected current, two processes take place: 
the Na* current both deinactivates (variable h increases) and deactivates (variable m = 
M.~o(V) decreases). Since m.(V) is flatter than h..(V), deinactivation is stronger than 
deactivation and the Na* conductance, gxamh, increases. This leads to an imbalance 
of the inward current and to the generation of the first spike. During the spike, the 
current inactivates completely, and the leak and negative injected currents repolarize 
and then hyperpolarize the membrane. During the hyperpolarization, clearly seen in 
the figure, the Nat current deinactivates and is ready for the generation of the next 
spike. 
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To understand the dynamic mechanism of such an inhibition-induced spiking, we 
need to consider the geometry of the nullclines of the model, depicted in Fig.7.32 
(right). Note how the position of the V-nullcline depends on J. Negative J shifts the 
nullcline down and leftward so that the vertex of its left knee, marked by a dot, moves 
to the left. As a result, the equilibrium of the system, which is the intersection of the 
V- and h-nullclines, moves toward the middle branch of the cubic V-nullcline. When 
I = —2, the equilibrium loses stability via supercritical Andronov-Hopf bifurcation, 
and the model exhibits periodic activity. 

Instead of the Iya4-model, we could have used the Jy, + Jx-model or any other 
model with a low-threshold resonant gating variable. The key point here is not the ionic 
basis of the spike generation mechanism, but its dynamic attribute — the Andronov- 
Hopf bifurcation. Even the FitzHugh-Nagumo model (4.11, 4.12) can exhibit this 
phenomenon (see exercise 1). 


7.2.9 Spike Latency 


In Fig.7.34 we illustrate an interesting neuronal property - latency to first spike. A 
barely superthreshold stimulation evokes action potentials with a significant delay, 
which could be as large as a second in some cortical neurons. Usually, such a delay is 
attributed to slow charging of the dendritic tree or to the action of the A-current, which 
is a voltage-gated transient K* current with fast activation and slow inactivation. The 
current activates quickly in response to a depolarization and prevents the neuron from 
immediate firing. With time, however, the A-current inactivates and eventually allows 
firing. (A slowly activating Nat or Ca?* current would achieve a similar effect.) 

In Fig.7.35 we explain the latency mechanism from the dynamical systems point 
of view. Long latencies arise when neurons undergo saddle-node bifurcation, depicted 
in Fig.7.35 (left). When a step of current is delivered, the V-nullcline moves up so 
that the saddle and node equilibria that existed when J = 0 coalesce and annihilate 
each other. Although there are no equilibria, the vector field remains small in the 
shaded neighborhood, as if there were still a ghost of the resting equilibrium there (see 
section 3.3.5). The voltage variable increases and passes that neighborhood. As we 
discussed in exercise 3 of chapter 6, the passage time scales as 1/.// — I, where [, 
is the bifurcation point (see Fig.6.8). Hence, the spike is generated with a significant 
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Figure 7.35: Bifurcation mechanism of latency to first spike when the injected DC 
current steps from J = 0 to J > J,, where J, is a bifurcation value. The shaded circle 
denotes the region where vector field is small. Phase portraits of the [Na»+J«-model 
are shown. 


latency. If the bifurcation is on an invariant circle, then the state of the neuron returns 
to the shaded neighborhood after each spike, resulting in firing with small frequency, 
a characteristic of Class 1 excitability (see Fig.7.3). In contrast, if the saddle-node 
bifurcation is off an invariant circle, then the state does not return to the neighborhood, 
and the firing frequency can be large, as in Fig.7.34 or in the neostriatal and basal 
ganglia neurons reviewed in section 8.4.2. 

We see that the existence of long spike latencies is an innate neurocomputational 
property of integrators. It is still not clear how or when the brain uses it. Two of 
the most plausible hypotheses are 1) that neurons encode the strength of input into 
spiking latency, and 2) that neuronal responses become less sensitive to noise, since 
only prolonged inputs can cause spikes. 

Interestingly, resonators do not exhibit long latencies even though there is a neigh- 
borhood where the vector field is small and even zero, as we show in Fig.7.35 (right). 
When the current pulse is applied, the V-nullcline moves up and the voltage variable ac- 
celerates. However, it misses the shaded neighborhood, and the neuron fires an action 
potential practically without any latency. In exercise 5 we discuss why some mod- 
els near Andronov-Hopf bifurcation, including the Hodgkin-Huxley model in Fig.7.26, 
seem to exhibit small but noticeable latencies. In section 8.2.7 we show that latencies 
could result from slow charging of the dendritic compartment. In this case, integrator 
neurons exhibit latency to the first spike, while resonator neurons may exhibit latency 
to the second spike (after they fire the first, transient spike). 
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Figure 7.36: Bistability of the up-state and down-state of mitral cells in rat main 
olfactory bulb. The cells are integrators in the down-state and resonators in the up- 
state. Membrane potential recordings are modified from Heyward et al. (2001). The 
shaded area denotes the attraction domain of the up-state. 


7.2.10 Flipping from an Integrator to a Resonator 


One of the reasons we provided so many examples of neuronal systems in chapter 5 
was to convince the reader that all neuronal models can exhibit both saddle-node 
and Andronoy-Hopf bifurcations, depending on the parameters describing the ionic 
currents. Since the kinetics of ionic currents in neurons can change during development 
or due to the action of neuromodulators, neurons can switch from being integrators to 
being resonators. 


In Fig.7.36 we illustrate an interesting case: mitral cells in rat main olfactory bulb 
can exhibit bistability of membrane potential. That is, the potential can be in two 
states: down-state around —60 mV, and up-state around —50 mV (Heyward et al. 
2001). A sufficiently strong synaptic input can shift the cell between these states in 
a matter of milliseconds. An amazing observation is that the down-state is a stable 
node and the up-state is a stable focus, as we illustrate at the bottom of the figure and 
study in detail in section 8.4.5. As a result, mitral cells can be quickly switched from 
being integrators to being resonators by synaptic input. 
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Figure 7.37: Fast subthreshold oscillations during complex spikes of cerebellar Purkinje 
neuron of a guinea-pig. (Data was by Yonatan Loewenstein.) 
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Figure 7.38: Is there an intermediate mode between integrators and resonators? 


A similar phenomenon was observed in a cerebellar Purkinje neuron (see Fig.7.37) 


It acts as an integrator in the down-state, but has fast (> 100 Hz) subthreshold oscil- 
lations in the up-state, and hence can act as a resonator. 


Cortical pyramidal neurons can also exhibit up- and down-states, though the states 
are not intrinsic, but induced by the synaptic activity. Since the neurons are depo- 
larized in the up-state, there is an interesting possibility that fast K* conductances 
are partially activated and the fast Nat inactivation gate is partially inactivated so 
that the neuron exhibits fast subthreshold oscillations and acts as a resonator. That 


is, integrator neurons can switch to the resonator mode when in the up-state. This 
possibility needs to be tested experimentally. 
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Figure 7.39: Bogdanov-Takens bifurcation in the Ij, + I«-model (4.1, 4.2). Parameters 
are as in Fig.4.1a, except n.o(V) has k = 7 mV and Vi/2 = —31.64 mV, Freak = —79.42 
and J = 5. Integrator: Vi. = —31 mV and J = 4.3. Resonator: Vj. = —34 mV and 
i= 7, 
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7.2.11 Transition Between Integrators and Resonators 


Consider the [y,+/«-model or any other minimal model from chapter 5 that can exhibit 
saddle-node or Andronov-Hopf bifurcation, depending on the parameter values. Let us 
start with the Jy, +J«-model near saddle-node bifurcation, and hence in the integrator 
mode. The intersection of its nullclines at the left knee is similar to the one in Fig.7.38 
(left). Now, slowly change the parameters toward the values corresponding to the 
Andronov-Hopf bifurcation with the nullclines intersecting as in Fig.7.38 (right). At 
some point, the behavior of the model must change from integrator to resonator mode. 
Is the change sudden, or is it gradual? 

Any qualitative change of the behavior of the system is a bifurcation. Such a bifur- 
cation should somehow combine the saddle-node and the Andronov-Hopf cases. That 
is, it should have a zero eigenvalue, and a pair of complex-conjugate eigenvalues with 
zero real part. Since the Jy, + [k-model is two-dimensional, these two conditions are 
satisfied only when the model undergoes the Bogdanov-Takens bifurcation considered 
in section 6.3.3. This bifurcation has codimension-2, that is, it can be reliably observed 
when two parameters are changed — in this case, Ejca, and the half-voltage, Vi/2, of 
esl V J: 

The top of Fig.7.39 depicts the phase portrait of the Ija+J«-model at the Bogdanov- 
Takens bifurcation. Note that the nullclines are tangent near the left knee, but the 
tangency is degenerate. A small change of the parameter Vj) can result in either a 
saddle and a node (middle of the figure) or a focus equilibrium (bottom of the figure). 
The neuron acts as an integrator in the former case and as a resonator in the latter 
case. 

Due to the proximity to a codimension-2 bifurcation, the behavior of the Iya + Ik- 
model is quite degenerate. That is, it can exhibit features that are normally not 
observed. For example, the integrator can exhibit postinhibitory spiking, as in Fig.7.40. 
This occurs because the shaded region in the figure, bounded by the stable manifold 
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Figure 7.40: Postinhibitory spike of an integrator neuron near Bogdanov-Takens bifur- 
cation; see Fig.7.39. 
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resonator integrator 


Figure 7.41: Postinhibitory facilitation — enhancement of subthreshold depolarizing 
pulse (2) by preceding inhibitory pulse (1) — can occur in integrator neurons near 
Bogdanov-Takens bifurcation. 


of the saddle, goes to the left of the resting state. An inhibitory pulse of current that 
hyperpolarizes the membrane potential to V < —65 mV and deactivates the Kt current 
to n < 0.005 pushes the point (V,7) to the shaded region (i.e., beyond the threshold). 
Upon release from inhibition, the integrator neuron produces a rebound spike and then 
returns to the resting state. 

Integrator neurons can also exhibit frequency preference and resonance, as illus- 
trated in Fig.7.41. The postinhibitory facilitation in resonator neurons in Fig.7.4la 
was described in section 7.2.7. It may occur in integrator neurons when the node equi- 
librium has nearly equal eigenvalues and nearly parallel eigenvectors, as in Fig.7.41b. 
The former are about to become complex-conjugate resulting in rotation of the vector 
field around the equilibrium, and hence in the postinhibitory rebound response to the 
first (inhibitory) pulse. 

Resonator neurons near a Bogdanov-Takens bifurcation can fire spikes with notice- 
able latencies. This occurs because the V-nullcline follows the n-nullcline at the focus 
equilibrium in Fig.7.39 (bottom). Such a proximity creates a “tunnel” with a small 
vector field that slows the spiking trajectory. Finally, the neuron can exhibit an oscil- 
lation (marked P in Fig.7.42, bottom) before firing a spike in response to a pulse of 
current. Of course, these behaviors are difficult to catch experimentally, because the 
system must be near a codimension-2 bifurcation. 


7.3 Slow Modulation 


So far we have considered neuronal models having voltage- or Ca?*-gated conductances 
operating on a fast time scale comparable with the duration of a spike. Such conduc- 
tances participate directly or indirectly in the generation of each spike and subsequent 
repolarization of the membrane potential. In addition, neurons have dendritic trees 
and some slow conductances and currents that may not be involved in the spike gen- 
eration mechanism directly, but rather may modulate it. For example, some cortical 
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Figure 7.42: Proximity to Bogdanov-Takens bifurcation in layer 5 pyramidal neuron of 
rat primary visual cortex results in slow subthreshold oscillation before a spike. Shown 
are a hand-drawn phase portrait and in vitro recordings obtained while an automated 
procedure was testing the neuronal rheobase. 


pyramidal neurons have Jy, and all thalamocortical neurons have [, and Igar). Ac- 
tivation and inactivation kinetics of these currents are too slow to participate in the 
generation of the upstroke or downstroke of a spike, but the currents can modulate the 
spiking pattern (e.g., they can transform it into bursting). 

To illustrate the phenomenon of slow modulation, we use the InaptJK +Jkqwp- 
model 


INap+1k-model Tx) 
. a aN 
CV = I—g,(V — E,) —gnaMo(V)(V— Ena) —9kn(V — Ex) — guru (V — Ex) (FL) 


Th = (Moo(V) — n)/7(V) 
MM = (Neom(V) — mu)/™(V) (slow Kt M-current), 


whose excitable and spiking properties are similar to those of the JNap»+JxK-submodel 
on a short time scale. However, the long-term behavior of the two models may be quite 
different. For example, the Kt M-current may result in frequency adaptation during a 
long train of action potentials. It can change the shape of the I-V relation of the model 
and result in slow oscillations, postinhibitory spikes, and other resonator properties 
even when the INap»+Jxk-submodel is an integrator. All these interesting phenomena 
are discussed in this section. 
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Figure 7.43: Spike frequency adaptation in layer 5 pyramidal cell (see Fig.7.3). Ramp 
data are from Fig.7.6. 


In general, models having fast and slow currents, such as (7.1), can be written in 
the fast-slow form 


CS FG, %) (fast spiking), 


uw = pg(x,u) (slow modulation), (7.2) 


where the vector x € IR” describes fast variables responsible for spiking. It includes the 
membrane potential V and activation and inactivation gating variables for fast currents, 
among others. The vector u € R* describes relatively slow variables that modulate fast 
spiking, e.g., the gating variable of a slow K*current, the intracellular concentration 
of Ca?" ions, etc. The small parameter pz represents the ratio of time scales between 
spiking and its modulation. Such systems often result in bursting activity, and we 
study them in detail in chapter 9. 
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Figure 7.44: Spike-frequency acceleration of a cortical fast spiking (FS) interneuron. 
Data kindly provided by Barry Connors. 


7.3.1 Spike Frequency Modulation 


Slow currents can modulate the instantaneous spiking frequency of a long train of 
action potentials, as we illustrate in Fig.7.43a, using recordings of a layer 5 pyramidal 
neuron. The neuron generates a train of spikes with increasing interspike interval (see 
inset in the figure) in response to a long pulse of injected DC current. In Fig.7.43b 
we plot the instantaneous interspike intervals 7;, that is, the time intervals between 
spikes 7 and z+ 1, as a function of the magnitude of injected current J. Notice that 
Ti(I) < Tj4i(1), meaning that the intervals increase with each spike. The function 
To(I) describes the latency of the first spike, and T,,(/) describes the steady-state 
(asymptotic) interspike period. The instantaneous frequencies, defined as F;(I) = 
1000/T;(Z) (Hz), are depicted in Fig.7.43c. Since the neuron is Class 1 excitable, the 
F-I curves are square-root parabolas (see section 6.1.2). Note that Fo(/) is nearly a 
straight line, probably reflecting the passive charging of the dendritic tree. 

Decrease of the instantaneous spiking frequency, as in Fig.7.43, is referred to as 
spike-frequency adaptation. This is a prominent feature of cortical pyramidal neurons 
of the regular spiking (RS) type (Connors and Gutnick 1990), as well as of many 
other types of neurons discussed in chapter 8. In contrast, cortical fast spiking (FS) 
interneurons (Gibson et al. 1999) exhibit spike frequency acceleration, depicted in 
Fig.7.44, that is, the instantaneous interspike intervals decrease, and the frequency 
increases with each spike. 
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Whether a neuron exhibits spike frequency adaptation or acceleration depends on 
the nature of the slow current or currents and how they affect the spiking limit cycle 
of the fast subsystem. At first glance, a resonant slow current (e.g., a slowly activating 
K* or slowly inactivating Na* current) builds up during each spike and provides a 
negative feedback that should slow spiking of the fast subsystem. Buildup of a slow 
amplifying current (e.g., a slowly activating Nat or inactivating Kt current) or slow 
charging of the dendritic tree should have the opposite effect. In chapter 9, devoted 
to bursting, we will show that this simple rule works for many models, but there are 
also many exceptions. To understand how the slow subsystem modulates repetitive 
spiking, we need to consider bifurcations of the fast subsystem in (7.2), treating the 
slow variable u as a bifurcation parameter. 


7.3.2 I-V Relation 


Slow currents and conductances, though not responsible for the generation of spikes, 
can mask the true I-V relation of the fast subsystem in (7.2) responsible for spiking. 
Take, for example, the Jya)+/x-model with parameters as in Fig.4.la (high-threshold 
Kt current) that has nonmonotonic I-V curve with a region of negative slope, depicted 
in Fig.7.45a. Such a system is near saddle-node on invariant circle bifurcation and it 
acts as an integrator. Now add a slow Kt M-current with an I-V relation depicted as 
a dashed curve in the figure and a time constant 7, = 100 ms. The spike generating 
mechanism of the combined Iya yt+lK+JK(mj-model is described by the fast Ina pt+lk- 
submodel, so that the neuron continues to have integrator properties, at least on the 
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Figure 7.45: Slow conductances can mask the true I-V relation of the spike generating 
mechanism. (a) The /Nap»+/x-model with parameters as in Fig.4.la has a nonmono- 
tonic I-V curve Ims(V). Addition of the slow K+ M-current with parameters as in 
section 2.3.5 and gy = 5 (dashed curve) makes the asymptotic I-V relation, [,,(V), 
of the full INap+JK+Jk my-model monotonic. (b) Addition of a slow inactivation gate 
to the Kt current of the INap»+/«-model with parameters as in Fig.4.1b results in a 
nonmonotonic asymptotic I-V relation of the full INa»+/a-model. 
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millisecond time scale. However, the asymptotic I-V relation [,.(V) is dominated by 
the strong Ik(m)(V) and is monotonic, as if the Iya ypt+JK+Jkimy-model were a resonator. 
The model can indeed exhibit some resonance properties, such as postinhibitory (re- 
bound) responses, but only on the long time scale of hundreds of milliseconds, which 
is the time scale of the slow Kt M-current. 


Similarly, we can take a resonator model with a monotonic I-V relation and add a 
slow amplifying current or a gating variable to get a non-monotonic /,,.(V), as if the 
model becomes an integrator. For example, in Fig.7.45b we use the [na »+/«-model 
with parameters as in Fig.4.1b (low-threshold Kt current) and adds an inactivation 
gate to the persistent K* current, effectively transforming it into transient A-current. 
If the inactivation kinetics is sufficiently slow, the INa,+J/a-model retains resonator 
properties on the millisecond time scale, which is the time scale of individual spikes. 
However, its asymptotic I-V relation, depicted in Fig.7.45b, becomes non-monotonic. 
Besides spike-frequency acceleration, the model acquires another interesting property: 
bistability. A single spike does not inactivate I, significantly. A burst of spikes can 
inactivate the Kt A-current to such a degree that repetitive spiking becomes sustained. 
Slow inactivation of the A-current is believed to facilitate the transition from down- 
states to up-states in neocortical and neostriatal neurons. 


When a neuronal model consists of conductances operating on drastically different 
time scales, it has multiple I-V relations, one for each time scale. We illustrate this 
phenomenon in Fig.7.46, using the INap,t+Jk+Jk(mj-model with an activation time con- 
stant of 0.01 ms for JNay, 1 ms for fx, and 100 ms for Ji). The upstroke of an action 
potential is described only by leak and persistent Na* currents, since the K* currents 
do not have enough time to activate during such a short event. During the upstroke, 
the model can be reduced to a one-dimensional system (see chapter 3) with instanta- 
neous I-V relation Jo(V) = teak + Inap(V) depicted in Fig.7.46a. The dynamics during 
and immediately after the action potential is described by the fast Iya »)+Jk-subsystem 
with its LV relation Ifast(V) = Io(V) + Ik(V). Finally, the asymptotic I-V relation, 
Tx(V) = Ttast(V) + Ikamy(V), takes into account all currents in the model. 


The three I-V relations determine the fast, medium, and asymptotic behavior of 
a neuron in a voltage-clamp experiment. If the time scales are well separated (they 
are in Fig.7.46), all three I-V relations can be measured from a simple voltage-clamp 
experiment, depicted in Fig.7.46b. We hold the model at V = —70 mV and step 
the command voltage to various values. The values of the current, taken at t = 0.05 
ms, t = 5 ms, and t = 500 ms in Fig.7.46b, result in the instantaneous, fast, and 
steady-state I-V curves, respectively. Notice that the data in Fig.7.46b are plotted 
on the logarithmic time scale. Various magnifications using the linear time scale are 
depicted in Fig.7.46c,d, and e. Numerically obtained values of the three I-V relations 
are depicted as dots in Fig.7.46a. They approximate the theoretical values quite well 
because there is a 100-fold separation of time scales in the model. 
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Figure 7.46: (a) The Inap+Jx+Jkmj-model in Fig.7.45a has three I-V relations: In- 
stantaneous [p(V) = Neak(V) + Ina,p(V) describes spike upstroke dynamics. The curve 
Trast(V) = Io(V) + Ik(V) is the I-V relation of the fast Iva»+J«-subsystem responsible 
for the spike generation mechanism. The curve I,.(V) = Ifast(V) + Ikawy(V) is the 
steady-state (asymptotic) I-V relation of the full model. Dots denote values obtained 
from a simulated voltage-clamp experiment in (b); note the logarithmic time scale. 
Magnifications of current responses are shown in (c — e). Simulated time constants: 
Tap V ) = 0.01 ms; 7c(V) = 1 ms, Tu(V) = 100 ms. 


7.3.3. Slow Subthreshold Oscillation 


Interactions between fast and slow conductances can result in low-frequency subthresh- 
old oscillation of membrane potential, such as the one in Fig.7.47, even when the fast 
subsystem is near a saddle-node bifurcation, acts as an integrator, and cannot have 
subthreshold oscillations. The oscillation in Fig.7.47 is caused by the interplay between 
activation and inactivation of the slow Ca?*+ T-current and the inward h-current, and 
it is a precursor of bursting activity (which we consider in detail in chapter 9). 

There are at least three different mechanisms of slow subthreshold oscillations of 
membrane potential of a neuron. 


e The fast subsystem responsible for spiking has a small-amplitude subthreshold 
limit cycle attractor. The period of the limit cycle may be much larger than the 
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Figure 7.47: Slow subthreshold oscillation of membrane potential of cat thalamocortical 
neuron evoked by slow hyperpolarization. (Modified from Roy et al. 1984.) 


time scale of the slowest variable of the fast subsystem when the cycle is near a 
saddle-node on invariant circle, saddle homoclinic orbit bifurcation, or Bogdanovy- 
Takens bifurcation (considered in chapter 6). In this case, no slow currents or 
conductances modulating the fast subsystem are involved. However, such a cycle 
must be near the bifurcation; hence the low-frequency subthreshold oscillation 
exists in a narrow parameter range and it is difficult to be seen experimentally. 


e The I-V relation of the fast subsystem has an N-shape in the subthreshold voltage 
range, so that there are two stable equilibria corresponding to two resting states 
(as, e.g., in Fig.7.36). A slow resonant variable switches the fast subsystem 
between those two states via a hysteresis loop, resulting in a subthreshold slow 
relaxation oscillation. 


e If the fast subsystem has a monotonic I-V relation, then a stable subthreshold 
oscillation can result from the interplay between slow variables. 


The first case does not need any slow variables; the second case needs only one slow 
variable; and the third case may need at least two. 


7.3.4 Rebound Response and Voltage Sag 


A slow resonant current can cause a neuron to fire a rebound spike or a burst in re- 
sponse to a sufficiently long hyperpolarizing current, even when the spike generating 
mechanism of the neuron is near a saddle-node bifurcation and hence has the neuro- 
computational properties of an integrator. For example, the cortical pyramidal neuron 
in Fig.7.48a has a slow resonant current [,, which is opened by hyperpolarization. A 
short pulse of current does not open enough of Jj, and results only in a small subthresh- 
old rebound potential. In contrast, a long pulse of current opens enough J), resulting 
in a strong inward current that produces the voltage sag and, upon termination of 
stimulation, drives the membrane potential over the threshold. 

Similarly, the thalamocortical neuron in Fig.7.48b has a low-threshold Ca?* T- 
current Jar) that is partially activated but completely inactivated at rest. A negative 
pulse of current hyperpolarizes the neuron and deinactivates the T-current, thereby 
making it available to generate a spike. Note that there is no voltage sag in Fig.7.48b 
because the T-current is deactivated at low membrane potentials. Upon termination of 
the long pulse of current, the membrane potential returns to the resting state around 
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Figure 7.48: Rebound responses to long inhibitory pulses in (a) pyramidal neuron of 
sensorimotor cortex of juvenile rat (modified from Hutcheon et al. 1996) and (b) rat 
auditory thalamic neurons. (Modified from Tennigkeit et al. 1997.) 
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Figure 7.49: Postinhibitory facilitation (a) and post-excitatory depression (b) in a layer 
5 pyramidal neuron (IB type) of rat visual cortex recorded in vitro in response to a 
long hyperpolarizing pulse. 


—68 mV, and the Ca?* T-current activates (but does not have time to inactive) and 
drives the neuron over the threshold. A distinctive feature of thalamocortical neurons 
is that they fire a rebound burst of spikes in response to strong negative currents. 

Even when the rebound depolarization is not strong enough to elicit a spike, it 
may increase the excitability of the neuron, so that it fires a spike to an otherwise 
subthreshold stimulus, as in Fig.7.49a. This type of postinhibitory facilitation relies 
on the slow currents, and not on the resonant properties of the spike generation mecha- 
nism (as in Fig.7.31). Figure 7.49b demonstrates the inverse property, post-excitatory 
depression, that is, a decreased excitability after a transient depolarization. In this 
seemingly counterintuitive case, a superthreshold stimulation becomes subthreshold 
when it is preceded by a depolarized pulse, because the pulse partially inactivates the 
Nat current and/or activates the K* current. 


7.3.5 MHP and ADP 

The membrane potential may undergo negative and positive deflections right after 
the spike, as illustrated in Fig.7.50 and Fig.7.51. These are known as afterhyperpo- 
larizations (AHP) and afterdepolarizations (ADP). The latter are sometimes called 
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Figure 7.50: Afterhyperpolarizations (AHP) and afterdepolarizations (ADP) in intrin- 
sically bursting (IB) pyramidal neurons of the rat motor cortex, recorded in vitro. 


Figure 7.51: Rebound spikes and afterdepolarization 
(marked ADP) at the break of hyperpolarizing cur- 
rent in thalamocortical neurons of the cat dorsal lat- 
eral geniculate nucleus. (Data modified from Pirchio 
et al. 1997; resting potential is —56 mV, holding po- 
tential is —67 mV.) 


depolarizing afterpotentials (DAP). A great effort is usually made to determine the 
ionic basis of AHPs and ADPs, since it is often implicitly assumed that they are gen- 
erated by slow currents that turn on right after the spike, such as the slow Ca?+-gated 
Ktcurrent I,yp or the slow persistent Nat current, respectively. Below we discuss 
these and other mechanisms. 

Let us consider the AHP first. Each spike in the initial burst in Fig.7.50 presumably 
activates a slow voltage- or Ca?t-dependent outward Kt current, which eventually 
stops the burst and hyperpolarizes the membrane potential. During the AHP period, 
the slow outward current deactivates, and the neuron can fire again. The neuron can 
switch from bursting to tonic spiking mode due to the incomplete deactivation of the 
slow current. The same explanation holds if we replace “activation of outward” with 
“inactivation of inward” current. 

Similarly, slow inactivation of the transient Ca?* T-current explains the rebound 
response and the long afterdepolarization (marked ADP) in Fig.7.51: The current 
was deinactivated by the preceding hyperpolarization, so upon release from the hy- 
perpolarization, it quickly activates and slowly inactivates, thereby producing a slow 
depolarizing wave on which fast spikes can ride. The ADP seen in the figure is the tail 
of the wave. 

Probably the most common mechanism of ADPs is due to the dendritic spikes, 
at least in pyramidal neurons of neocortex considered in chapter 8. In Fig.7.52a we 
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Figure 7.52: (a) A somatic spike evokes a dendritic spike, which in turn produces 
afterdepolarization (ADP) in the soma of the pyramidal neuron of rat somatosensory 
cortex (in vitro recording was provided Greg Stuart and Maarten Kole). (b) and (c) 
Increased level of depolarization in another neuron (the same as in Fig.7.49) converts 
ADP to a second spike. 


depict a dual somatic/dendritic recording of the membrane potential of a pyramidal 
neuron. The somatic spike backpropagates into the dendritic tree, activates voltage- 
gated conductances there, and results in a slower dendritic spike. The latter depolarizes 
the soma and produces a noticeable ADP. Recordings of another neuron in Fig.7.52b 
and c show that if there is an additional source of depolarization, such as the injected 
DC current, the ADPs can grow and result in a second spike. This may evoke another 
dendritic spike, another ADP or spike, and so on. Such a somatic-dendritic ping-pong 
(Wang 1999; Doiron et al. 2002) results in a bursting activity discussed in section 8.2.2. 


In contrast, adult CA1 pyramidal neurons in hippocampus generate ADP and burst- 
ing even when their apical dendrites are cut (Yue et al. 2005; Golomb et al. 2006). 
The ADP there is caused by the slow deactivation of somatic persistent Nat current. 

Slow ADPs can also be generated by a nonlinear interplay of fast currents responsi- 
ble for spiking, rather than by slow currents or dendritic spikes. One obvious example 
is the damped oscillation of membrane potential of the [y,,,+J/«K-model in Fig.7.53 im- 
mediately after the spike, with the trough and the peak corresponding to an AHP and 
an ADP, respectively. Note that the duration of the ADP is ten times the duration of 
the spike even though the model does not have any slow currents. Such a long-lasting 
effect appears because the trajectory follows the separatrix, comes close to the saddle 
point, and spends some time there before returning to the stable resting state. 

An example in Fig.7.54 shows the membrane potential of a model neuron slowly 
passing through a saddle-node on invariant circle bifurcation. Because the vector field 
is small at the bifurcation, which takes place around t = 70 ms, the membrane po- 
tential is slowly increasing along the limit cycle and then slowly decreasing along the 
locus of stable node equilibria, thereby producing a slow ADP. In chapter 9 we will 
show that such ADPs exist in 4 out of 16 basic types of bursting neurons, including 
thalamocortical relay neurons and Rj; bursting cells in the abdominal ganglion of the 
mollusk Aplysia. 
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Figure 7.53: A long afterdepolarization (ADP) in the Iya)+J/x-model without any slow 
currents. Parameters are as in Fig.6.52. 


saddle-node on invariant circle 
bifurcation 


invariant circle 


membrane potential, V (mV) 


-80 i 1 i | 1 i 1 1 | 
0 20 40 60 80 100 120 140 160 180 200 
time (ms) 


Figure 7.54: Afterdepolarization in the [y,,»+J«-model passing slowly through saddle- 
node on invariant circle bifurcation, as the magnitude of the injected current ramps 
down. 
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Review of Important Concepts 


e A neuron is excitable because, as a dynamical system, it is near a 
bifurcation from resting to spiking activity. 


The type of bifurcation determines the neuron’s computational prop- 
erties, summarized in Fig.7.15. 


Saddle-node on invariant circle bifurcation results in Class 1 ex- 
citability: the neuron can fire with arbitrarily small frequency and 
encode the strength of input into the firing rate. 


Saddle-node off invariant circle and Andronov-Hopf bifurcations re- 
sult in Class 2 excitability: the neuron can fire only within a certain 
frequency range. 


Neurons near saddle-node bifurcation are integrators: they prefer 
high-frequency excitatory input, have well-defined thresholds, and 
fire all-or-none spikes with some latencies. 


Neurons near Andronov-Hopf bifurcation are resonators: they have 
oscillatory potentials, prefer resonant-frequency input, and can eas- 
ily fire postinhibitory spikes. 


Bibliographical Notes 


There is no universally accepted definition of excitability. Our definition is consistent 
with the one involving ¢-pseudo orbits (Izhikevich 2000a). FitzHugh (1955, 1960, 1976) 
pioneered geometrical analyses of phase portraits of neuronal models with the view to 
understanding their neurocomputational properties. It is amazing that such impor- 
tant neurocomputational properties as all-or-none action potentials, firing thresholds, 
and integration of EPSPs are still introduced and illustrated using the Hodgkin- Hux- 
ley model, which according to FitzHugh, cannot have these properties. Throughout, 
this chapter follows Izhikevich (2000a) to compare and contrast neurocomputational 
properties of integrators and resonators. 

The frozen noise experiment in Fig.7.24 was pioneered by Bryant and Segundo 
(1976), but due to an interesting quirk of history, it is better known at present as the 
Mainen-Sejnowski (1995) experiment (despite the fact that the latter paper refers to the 
former). Postinhibitory facilitation was pointed out by Luk and Aihara (2000) and later 
by Izhikevich (2001). John Rinzel suggested calling it “postinhibitory exaltation” (in a 
similar vein; the phenomenon in Fig.7.49b may be called “post-excitatory hesitation” ). 
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Richardson et al. (2003) pointed out that frequency preference and resonance may 
occur without subthreshold oscillations when the system is near the transition from an 
integrator to a resonator. 

The Hodgkin classification of neuronal excitability can be used to classify any rhyth- 
mic system, even contractions of the uterus during labor. Typically, the contractions 
start with low frequency that gradually increases — Class 1 excitability. My wife had 
to have labor induced pharmacologically, a typical medical intervention when the baby 
is overdue. The contraction monitor showed a sinusoidal signal with constant period, 
around 2 minutes, but slowly growing amplitude — Class 2 excitability via supercritical 
Andronov-Hopf bifurcation! Since my wife has an advanced degree in applied math- 
ematics, I waited for a 1-minute period of quiescence between the contractions and 
managed to explain to her the basic relationship between bifurcations and excitability. 
Five years later, induced delivery of our second daughter resulted in the same super- 
critical Andronov-Hopf bifurcation. I recalled this for my wife and explained it to the 
obstetrician minutes after the delivery. 


Exercises 


1. When can the FitzHugh-Nagumo model (4.11, 4.12) exhibit inhibition-induced 
spiking, such as in Fig.7.32? 


2. (Canards) Numerically investigate the quasi-threshold in the FitzHugh-Nagumo 
model (4.11, 4.12). How is it related to the canard (French duck; see Eckhaus 
1983) limit cycles discussed in section 6.3.4? 


3. (Noise-induced oscillations) Consider the system 
Z=(-et+iw)z+el(t), zeEC (7.3) 


which has a stable focus equilibrium z = 0 and is subject to a weak noisy input 
eI(t). Show that the system exhibits sustained noisy oscillations with an average 
amplitude |/*(w)|, where 


is the Fourier coefficient of [(t) corresponding to the frequency w. 


4. (Frequency preference) Show that a system exhibiting damped oscillation with 
frequency w is sensitive to an input having frequency w in its power spectrum. 
(Hint: use exercise 3.) 


5. (Rush and Rinzel 1995) Use the phase portrait of the reduced Hodgkin-Huxley 
model in Fig.5.21 to explain some small but noticeable latencies in Fig.7.26. 
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— 


Figure 7.55: exercise 6: Zero frequency firing near subcritical Andronoyv-Hopf bifurca- 
tion in the [Nap»+/«-model with parameters as in Fig.6.16 and a high-threshold slow 
Kt current (9x aay = 25, Tksiow = 10 Mis, Neo siew(V): has Vie. =10- mV and k= 5 
mV.) 


6. The neuronal model in Fig.7.55 has a high-threshold slow persistent Kt current. 
Its resting state undergoes a subcritical Andronov-Hopf bifurcation, yet it can 
fire low-frequency spikes, and hence exhibits Class | excitability. Explain. (Hint: 
Show numerically that the model is near a certain codimension-2 bifurcation 
involving a homoclinic orbit.) 


7. Show that the resting state of a Class 3 excitable conductance-based model is 
near an Andronov-Hopf bifurcation if some other variable, not J, is used as a 
bifurcation parameter. 


Chapter 8 


Simple Models 


The advantage of using conductance-based models, such as the [y,+J/«-model, is that 
each variable and parameter has a well-defined biophysical meaning. In particular, 
they can be measured experimentally. The drawback is that the measurement proce- 
dures may not be accurate: the parameters are usually measured in different neurons, 
averaged, and then fine-tuned (a fancy term meaning “to make arbitrary choices”). As 
a result, the model does not have the behavior that one sees in experiments. And even 
if it “looks” right, there is no guarantee that the model is accurate from the dynamical 
systems point of view, that is, it exhibits the same kind of bifurcations as the type of 
neuron under consideration. 

Sometimes we do not need or cannot afford to have a biophysically detailed conduc- 
tance-based model. Instead, we want a simple model that faithfully reproduces all the 
neurocomputational features of the neuron. In this chapter we review salient features 
of cortical, thalamic, hippocampal, and other neurons, and we present simple models 
that capture the essence of their behavior from the dynamical systems point of view. 


8.1 Simplest Models 


Let us start with reviewing the simplest possible models of neurons. As one can 
guess from their names, the integrate-and-fire and resonate-and-fire neurons capture 
the essence of integrators and resonators, respectively. The models are similar in many 
respects: both are described by linear differential equations, both have a hard firing 
threshold and a reset, and both have a unique stable equilibrium at rest. The only 
difference is that the equilibrium is a node in the integrate-and-fire case, but a focus 
in the resonate-and-fire case. One can model the former using only one equation, and 
the latter using only two equations, though multi-dimensional extensions are straight- 
forward. Both models are useful from the analytical point of view, that is, to prove 
theorems. 

Many scientists, including myself, refer to these neural models as “spiking models”. 
The models have a threshold, but they lack any spike generation mechanism, that is, 
they cannot produce a brief regenerative depolarization of membrane potential corre- 
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spike 


Figure 8.1: Leaky integrate- 
and-fire neuron with noisy 
input. The spike is added 
manually for aesthetic pur- 
poses and to fool the reader 
into believing that this is a 
spiking neuron. 


sponding to the spike upstroke. Therefore, they are not spiking models; the spikes in 
figures 8.1 and 8.2, as well as in hundreds of scientific papers devoted to these mod- 
els, are drawn by hand. The quadratic integrate-and-fire model is the simplest truly 
spiking model. 


8.1.1 Integrate-and-Fire 


The leaky integrate-and-fire model (Lapicque 1907; Stein 1967; Tuckwell 1988) is an 
idealization of a neuron having Ohmic leakage current and a number of voltage-gated 
currents that are completely deactivated at rest. Subthreshold behavior of such a 
neuron can be described by the linear differential equation 


Ohmic leakage 
CV =I- leak (V _ Freak); 


where all parameters have the same biophysical meanings as in the previous chap- 
ters. When the membrane potential V reaches the threshold value Ethresn, the voltage- 
sensitive currents instantaneously activate, the neuron is said to fire an action potential, 
and V is reset to Ex, as in Fig.8.1. After appropriate rescaling, the leaky integrate- 
and-fire model can be written in the form 


v=b-v, if y = 1, then v + 0, (8.1) 


where the resting state is v = b, the threshold value is v = 1, and the reset value is 
v = 0. Apparently the neuron is excitable when b < 1 and fires a periodic spike train 
when b > 1 with period T = —In(1 — 1/6). (The reader should verify this.) 

The integrate-and-fire neuron illustrates a number of important neurocomputa- 
tional properties: 


e All-or-none spikes. Since the shape of the spike is not simulated, all spikes are 
implicitly assumed to be identical in size and duration. 


e Well-defined threshold. A stereotypical spike is fired as soon as V = Ethresh, 
leaving no room for any ambiguity (see, however, exercise 1). 
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e Relative refractory period. When Ex < Eveax, the neuron is less excitable imme- 
diately after the spike. 


e Distinction between excitation and inhibition. Excitatory inputs (I > 0) bring 
the membrane potential closer to the threshold, and hence facilitate firing, while 
inhibitory inputs (I < 0) do the opposite. 


e Class 1 excitability. The neuron can continuously encode the strength of an input 
into the frequency of spiking. 


In summary, the neuron seems to be a good model for an integrator. 

However, a closer look reveals that the integrate-and-fire neuron has flaws. The 
transition from resting to repetitive spiking occurs neither via saddle-node nor via 
Andronov-Hopf bifurcation, but via some other weird type of bifurcation that can be 
observed only in piecewise continuous systems. As a result, the F-I curve has loga- 
rithmic scaling and not the expected square-root scaling of a typical Class 1 excitable 
system (see, however, exercise 19 in chapter 6). The integrate-and-fire model cannot 
have spike latency to a transient input because superthreshold stimuli evoke immedi- 
ate spikes without any delays (compare with Fig.8.8(1)). In addition, the model has 
some weird mathematical properties, such as non-uniqueness of solutions, as we show 
in exercise 1. Finally, the integrate-and-fire model is not a spiking model. Technically, 
it did not fire a spike in Fig.8.1, it was only “said to fire a spike”, which was manually 
added afterward to fool the reader. 

Despite all these drawbacks, the integrate-and-fire model is an acceptable sacrifice 
for a mathematician who wants to prove theorems and derive analytical expressions. 
However, using this model might be a waste of time for a computational neuroscientist 
who wants to simulate large-scale networks. At the end of this section we present 
alternative models that are as computationally efficient as the integrate-and-fire neuron, 
yet as biophysically plausible as Hodgkin-Huxley-type models. 


8.1.2 Resonate-and-Fire 


The resonate-and-fire model is a two-dimensional extension of the integrate-and-fire 
model that incorporates an additional low-threshold persistent K* current or h-current, 
or any other resonant current that is partially activated at rest. Let W denote the 
magnitude of such a current. In the linear approximation, the conductance-based 
equations describing neuronal dynamics can be written in the form 


CV = I — greax(V — Freak) — W , 
Ww (V —Vija)/k-W. 


known as the Young (1937) model (see also equation 2-1 in FitzHugh 1969). Whenever 
the membrane potential reaches the threshold value, Vihresnh, the neuron is said to fire 
a spike. Young did not specify what happens after the spike. The resonate-and-fire 
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Figure 8.2: Resonate-and-fire model with b = —0.05, w = 0.25, and Zresep = i. The 
spike was added manually. 


model is the Young model with the following resetting: if V > Vinresn, then V <— Vyeset 
and W + Whreset, Where Vrest ANd Wreset are Some parameters. 

When the resting state is a stable focus, the model can be recast in complex coor- 
dinates as 

Z=(b+iw)z+1, 

where b+ iw € C is the complex eigenvalue of the resting state, and z = x+iy € Cis 
the complex-valued variable describing damped oscillations with frequency w around 
the resting state. The real part, x, is a current-like variable. It describes the dynamics 
of the resonant current and synaptic currents. The imaginary part, y, is a voltage-like 
variable. The neuron is said to fire a spike when y reaches the threshold y = 1. Thus, 
the threshold is a horizontal line on the complex plane that passes through i € C, as 
in Fig.8.2, though other choices are also possible. After firing the spike, the variable z 
is reset tO Zreset: 

The resonate-and-fire model illustrates the most important features of resonators: 
damped oscillations, frequency preference, postinhibitory (rebound) spikes, and Class 2 
excitability. It cannot have sustained subthreshold oscillations of membrane potential. 

Integrate-and-fire and resonate-and-fire neurons do not contradict, but complement, 
each other. Both are linear, and hence are useful when we prove theorems and derive 
analytical expressions. They have the same flaws limiting their applicability, which 
were discussed earlier. In contrast, two simple models described below are difficult to 
treat analytically, but because of their universality they should be the models of choice 
when large-scale simulations are concerned. 


8.1.3. Quadratic Integrate-and-Fire 
Replacing —v with +v? in (8.1) results in the quadratic integrate-and-fire model 
v=b+v’, if v = Upeak, then v + Ureset; (8.2) 


which we considered in section 3.3.8. Here Upeak is not a threshold, but the peak (cut 
off) of a spike, as we explain below. It is useful to use Upeak = --0o in analytical studies. 
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In simulations, the peak value is assumed to be large but finite, so it can be normalized 
tO Upeak = l. 

Note that v = b+ v? is a topological normal form for the saddle-node bifurcation. 
That is, it describes dynamics of any Hodgkin-Huxley-type system near that bifurca- 
tion, as we discuss in chapter 3 and 6. There we derived the normal form (6.3) for the 
INap+Jx-model and showed that the two systems agree quantitatively in a reasonably 
broad voltage range. By resetting v tO Ureset, the quadratic integrate-and-fire model 
captures the essence of recurrence when the saddle-node bifurcation is on an invariant 
circle. 

When b > 0, the right-hand side of the model is strictly positive, and the neuron 
fires a periodic train of action potentials. Indeed, v increases, reaches the peak, resets 
tO Vreset; and then increases again, as we show in Fig.3.35 (top). In exercise 3 we prove 
that the period of such spiking activity is 


1 Upeak Ureset T 
T= = ( atan “2 atan “= ) oe 
so that the frequency scales as Vb, as in Class 1 excitable systems. 

When b < 0, the parabola b + v? has two zeroes, +4/b]. One corresponds to 
the stable node equilibrium (resting state), and the other corresponds to the unstable 
node (threshold state); see exercise 2. Subthreshold perturbations are those that keep 
v below the unstable node. Superthreshold perturbations are those that push v beyond 
the unstable node, resulting in the initiation of an action potential, reaching the peak 
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Figure 8.4: Phase portrait (a) and its magnification (b) of a typical neuronal model 
having voltage variable V and a recovery variable u. 


value Upeak, and then resetting to Vreset. If, in addition, reset > Jb , then there is a 
coexistence of resting and periodic spiking states, as in Fig.3.35 (middle). The period 
of the spiking state is provided in exercise 4. A two-parameter bifurcation diagram of 
(8.2) is depicted in Fig.8.3. 

Unlike its linear predecessor, the quadratic integrate-and-fire neuron is a genuine 
integrator. It exhibits saddle-node bifurcation; it has a soft (dynamic) threshold; and 
it generates spikes with latencies, as many mammalian cells do. Besides, the model 
is canonical in the sense that the entire class of neuronal models near saddle-node on 
invariant circle bifurcation can be transformed into this model by a piecewise con- 
tinuous change of variables (see section 8.1.5 and the Ermentrout-Kopell theorem in 
Hoppensteadt and Izhikevich 1997). In conclusion, the quadratic, and not the leaky, 
integrate-and-fire neuron should be used in simulations of large-scale networks of inte- 
grators. A generalization of this model is discussed next. 


8.1.4 Simple Model of Choice 


A striking similarity among many spiking models, discussed in chapter 5, is that they 
can be reduced to two-dimensional systems having a fast voltage variable and a slower 
“recovery” variable, which may describe activation of the K* current or inactivation 
of the Nat current or their combination. Typically, the fast variable has an N-shaped 
nullcline and the slower variable has a sigmoid-shaped nullcline. The resting state in 
such models is the intersection of the nullclines near the left knee, as we illustrate 
in Fig.8.4a. There, V and u denote the fast and the slow variable, respectively. In 
chapter 7 we showed that many computational properties of biological neurons can be 
explained by considering dynamics at the left knee. 

In section 5.2.4 we derive a simple model that captures the subthreshold behavior 
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Figure 8.5: The simple model (8.3, 8.4) can be an integrator or a resonator. Compare 
with Fig.7.27. 


in a small neighborhood of the left knee confined to the shaded square in Fig.8.4 and 
the initial segment of the upstroke of an action potential. In many cases, especially 
involving large-scale simulations of spiking models, the shape of the action potential is 
less important than the subthreshold dynamics leading to this action potential. Thus, 
retaining detailed information about the left knee and its neighborhood and simplifying 
the vector field outside the neighborhood is justified. 

The simple model 


I+v?-u ifv>1, then (8.3) 
= a(bv —u) vecueutd (8.4) 


has only four dimensionless parameters. Depending on the values of a and 0, it can 
be an integrator or a resonator, as we illustrate in Fig.8.5. The parameters c and d 
do not affect steady-state subthreshold behavior. Instead, they take into account the 
action of high-threshold voltage-gated currents activated during the spike, and affect 
only the after-spike transient behavior. If there are many currents with diverse time 
scales, then u,a,b, and d are vectors, and (8.3) contains )> wu instead of u. 

The simple model may be treated as a quadratic integrate-and-fire neuron with 
adaptation in the simplest case b = 0. When b < 0, the model can be treated as a 
quadratic integrate-and-fire neuron with a passive dendritic compartment (see exer- 
cise 10). When b > 0, the connection to the quadratic integrate-and-fire neuron is lost, 
and the simple model represents a novel class of spiking models. 

In the rest of this chapter we tune the simple model to reproduce spiking and 
bursting behavior of many known types of neurons. It is convenient to use it in the 
form 


Ct = k(v—v,)(v-—u,) —ut] if v > Upeak, then (8.5) 
au = a{b(v—v,)—u} vec,utudtd (8.6) 
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where v is the membrane potential, u is the recovery current, C is the membrane 
capacitance, v; is the resting membrane potential, and 1; is the instantaneous threshold 
potential. Though the model seems to have ten parameters, but it is equivalent to (8.3, 
8.4) and hence has only four independent parameters. As we described in section 5.2.4, 
the parameters k and b can be found when one knows the neuron’s rheobase and input 
resistance. The sum of all slow currents that modulate the spike generation mechanism 
is combined in the phenomenological variable u with outward currents taken with the 
plus sign. 

The sign of b determines whether u is an amplifying (b < 0) or a resonant (b > 0) 
variable. In the latter case, the neuron sags in response to hyperpolarized pulses of 
current, peaks in response to depolarized subthreshold pulses, and produces rebound 
(postinhibitory) responses. The recovery time constant is a. The spike cutoff value is 
Upeak, and the voltage reset value is c. The parameter d describes the total amount of 
outward minus inward currents activated during the spike and affecting the after-spike 
behavior. All these parameters can easily be fitted to any particular neuron type, as 
we show in subsequent sections. 


Implementation and Phase Portrait 


The following MATLAB code simulates the model and produces Fig.8.6a. 


C=100; vr=-60; vt=-40; k=0.7; 4 parameters used for RS 
a=0.03; b=-2; c=-50; d=100; % neocortical pyramidal neurons 
vpeak=35; % spike cutoff 

T=1000; tau=1; % time span and step (ms) 


n=round(T/tau) ; number of simulation steps 
vevr*ones(1,n); u=0*v; initial values 
T=[zeros(1,0.1*n) ,70*ones(1,0.9*n)];% pulse of input DC current 


of 


for i=1:n-1 forward Euler method 
v (itt) =v (i) +taux (k* (v (i) -vr) * (vi) -vt)-u(i)+1I(i))/C; 
u(it1)=u(i)+tauxa* (b* (v(i)-vr)-u(i)); 


if v(it+1)>=vpeak % a spike is fired! 
v(i)=vpeak; % padding the spike amplitude 
v(it1)=c; % membrane voltage reset 
u(it1)=u(it1)+d; % recovery variable update 
end; 
end; 
plot(tau*x(1:n), v); % plot the result 


Note that the spikes were padded to Upeak to avoid amplitude jitter associated with 
the finite simulation time step tau=1 ms. In Fig.8.6b we magnify the simulated voltage 
trace and compare it with a recording of a neocortical pyramidal neuron (dashed curve). 
There are two discrepancies, marked by arrows: In the first, the pyramidal neuron has 
(1) asharper spike upstroke and (2) a smoother spike downstroke. The first discrepancy 
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Figure 8.6: (a) Output of the MATLAB code simulating the simple model (8.5, 8.6). 
(b) Comparison of the simulated (solid curve) and experimental (dashed curve) voltage 
traces shows two major discrepancies, marked by arrows. (c) Phase portrait of the 
model. 


can be removed by assuming that the coefficient k of the square polynomial in (8.5) 
is voltage-dependent (e.g., k = 0.7 for v < u, and k = 7 for v > y%), or by using the 
modification of the simple model presented in exercise 13 and exercise 17. The second 
discrepancy results from the instantaneous after-spike resetting, and it less important 
because it does not affect the decision whether or when to fire. However, the slope 
of the downstroke may become important in studies of gap-junction-coupled spiking 
neurons. 

The phase portrait of the simple model is depicted in Fig.8.6c. Injection of the step 
of DC current J = 70 pA shifts the v-nullcline (square parabola) upward and makes 
the resting state, denoted by a black square, disappear. The trajectory approaches the 
spiking limit cycle attractor, and when it crosses the cutoff vertical line Upeak = 35 mV, 
it is reset to the white square, resulting in periodic spiking behavior. Note the slow 
afterhyperpolarization (AHP) following the reset that is due to the dynamics of the 
recovery variable u. Depending on the parameters, the model can have other types of 
phase portraits, spiking, and bursting behavior, as we demonstrate later. 

In Fig.8.7 we illustrate the difference between the integrate-and-fire neuron and the 
simple model. The integrate-and-fire model is said to fire spikes when the membrane 
potential reaches a preset threshold value. The potential is reset to a new value, and 
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Figure 8.7: Voltage reset in the integrate-and-fire model and in the simple model. 


the spikes are drawn by hand. In contrast, the simple model generates the upstroke 
of the spike due to the intrinsic (regenerative) properties of the voltage equation. The 
voltage reset occurs not at the threshold, but at the peak, of the spike. In fact, the 
firing threshold in the simple model is not a parameter, but a property of the bifurcation 
mechanism of excitability. Depending on the bifurcation of equilibrium, the model may 
not even have a well-defined threshold, a situation similar to many conductance-based 
models. 


When numerically implementing the voltage reset, whether at the threshold or at 
the peak of the spike, one needs to be aware of the numerical errors, which translate 
into the errors of spike timing. These errors are inversely proportional to the slope of 
the voltage trace (i.e. v) at the reset value. The slope is small in the integrate-and-fire 
model, so clever numerical methods are needed to catch the exact moment of threshold 
crossing (Hansel et al. 1998). In contrast, the slope is nearly infinite in the simple 
model, hence the error is infinitesimal, and no special methods are needed to identify 
the peak of the spike. 


In Fig.8.8 we used the model to reproduce the 20 of the most fundamental neu- 
rocomputational properties of biological neurons. Let us check that the model is the 
simplest possible system that can exhibit the kind of behavior in the figure. Indeed, it 
has only one nonlinear term, v?. Removing the term makes the model linear (between 
the spikes) and equivalent to the resonate-and-fire neuron. Removing the recovery 
variable u makes the model equivalent to the quadratic integrate-and-fire neuron with 
all its limitations, such as the inability to burst or to be a resonator. In summary, we 
found the simplest possible model capable of spiking, bursting, being an integrator or 
a resonator, and it should be the model of choice in simulations of large-scale networks 
of spiking neurons. 
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Figure 8.8: Summary of neurocomputational properties exhibited by the simple model; 
see exercise 11. The figure is reproduced, with permission, from www. izhikevich.com. 
(An electronic version of the figure, the MATLAB code that generates the voltage 
responses, and reproduction permissions are available at www.izhikevich.com.) 
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I am a mathematician. 
All I need is paper, a pencil, 
and a trash basket! 


Too bad you're 
not a philosopher, 
you wouldn't need 
the trash basket! 


Figure 8.9: A real conversation between the author of this book and his boss. 


8.1.5 Canonical Models 


It is quite rare, if ever possible, to know precisely the parameters describing dynamics 
of a neuron (many erroneously think that the Hodgkin-Huxley model of the squid 
axon is an exception). Indeed, even if all ionic channels expressed by the neuron are 
known, the parameters describing their kinetics are usually obtained via averaging over 
many neurons; there are measurement errors; the parameters change slowly, and so 
on. Thus, we are forced to consider families of neuronal models with free parameters 
(e.g. the family of Iya+Jx-models). It is more productive, from the computational 
neuroscience point of view, to consider families of neuronal models having a common 
property, e.g., the family of all integrators, the family of all resonators, or the family 
of “fold/homoclinic” bursters considered in the next chapter. How can we study the 
behavior of the entire family of neuronal models if we have no information about most 
of its members? 

The canonical model approach addresses this issue. Briefly, a model is canonical for 
a family if there is a piecewise continuous change of variables that transforms any model 
from the family into this one, as we illustrate in Fig.8.10. The change of variables does 
not have to be invertible, so the canonical model is usually lower-dimensional, simple, 
and tractable. Nevertheless, it retains many important features of the family. For 
example, if the canonical model has multiple attractors, then each member of the 
family has multiple attractors. If the canonical model has a periodic solution, then 
each member of the family has a periodic (quasi-periodic or chaotic) solution. If the 
canonical model can burst, then each member of the family can burst. The advantage 
of this approach is that we can study universal neurocomputational properties that 
are shared by all members of the family because all such members can be put into the 
canonical form by a change of variables. Moreover, we need not actually present such 
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Figure 8.10: Dynamical system y = g(y) is a canonical model for the family 
{ fi, fa, fs, fa} of neural models ~ = f(x) because each such model can be transformed 
into the form y = g(y) by the piecewise continuous change of variables h,. 


a change of variables explicitly, so derivation of canonical models is possible even when 
the family is so broad that most of its members are given implicitly (e.g., the family 
of “all resonators” ). 


The process of deriving canonical models is more an art than a science, since a 
general algorithm for doing this is not known. However, much success has been achieved 
in some important cases. The canonical model for a system near an equilibrium is 
the topological normal form at the equilibrium (Kuznetsov 1995). Such a canonical 
model is local, but it can be extended to describe global dynamics. For example, the 
quadratic integrate-and-fire model with a fixed Upesee < 0 is a global canonical model 
for all Class 1 excitable systems, that is, systems near saddle-node on invariant circle 
bifurcation. The same model with variable vreseg is a global canonical model for all 
systems near saddle-node homoclinic orbit bifurcation (considered in section 6.3.6). 

The phase model 7 = 1 derived in chapter 10 is a global canonical model for the 
family of nonlinear oscillators having exponentially stable limit cycle attractors. Other 
examples of canonical models for spiking and bursting can be found in subsequent 
chapters of this book. 


The vector-field of excitable conductance-based models in the subthreshold region 
and in the region corresponding to the upstroke of the spike can be converted into the 
simple form (8.3, 8.4), possibly with u being a vector. Therefore, the simple model 
(8.3, 8.4) is a local canonical model for the spike generation mechanism and the spike 
upstroke of Hodgkin-Huxley-type neuronal models. It is not a global canonical model 
because it ignores the spike downstroke. Nevertheless, it describes remarkably well the 
spiking and bursting dynamics of many biological neurons, as we demonstrate next. 
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Figure 8.11: The six most fundamental classes of firing patterns of neocortical neurons 
in response to pulses of depolarizing DC current. RS and IB are in vitro recordings 
of pyramidal neurons of layer 5 of primary visual cortex of a rat; CH was recorded in 
vivo in cat visual cortex (area 17; data provided by D. McCormick). FS was recorded 
in vitro in rat primary visual cortex, LTS was recorded in vitro in layer 4 or 6 of rat 
barrel cortex (data provided by B. Connors). LS was recorded in layer 1 of rat’s visual 
cortex (data provided by S. Hestrin). All recordings are plotted on the same voltage 
and time scale, and the data are available at www.izhikevich.com. 
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8.2 Cortex 


In this section we consider the six most fundamental classes of firing patterns observed 
in the mammalian neocortex and depicted in Fig.8.11 (Connors and Gutnick 1990; 
Gray and McCormick 1996; Gibson et al. 1999). Though most biologists agree with 
the classification in the figure, many would point out that it is greatly oversimplified 
(Markram et al. 2004), that the distinction between the classes is not sharp, that there 
are subclasses within each class (Nowak et al. 2003; Toledo-Rodriguez et al. 2004), and 
that neurons can change their firing class depending on the state of the brain (Steriade 
2004). 


e (RS) Regular spiking neurons fire tonic spikes with adapting (decreasing) fre- 
quency in response to injected pulses of DC current. Most of them have Class 1 
excitability in the sense that the interspike frequency vanishes when the ampli- 
tude of the injected current decreases. Morphologically, these neurons are spiny 
stellate cells in layer 4 and pyramidal cells in layers 2, 3, 5, and 6. 


e (IB) Intrinsically bursting neurons generate a burst of spikes at the beginning 
of a strong depolarizing pulse of current, then switch to tonic spiking mode. 
They are excitatory pyramidal neurons found in all cortical layers, but are most 
abundant in layer 5. 


e (CH) Chattering neurons fire high-frequency bursts of spikes with relatively short 
interburst periods; hence another name, FRB (fast rhythmic bursting). Output 
of such a cell fed to the loudspeaker “sounds a lot like a helicopter — cha, cha, 
cha — real fast”, according to Gray and McCormick (1996). CH neurons were 
found in visual cortex of adult cats, and morphologically they are spiny stellate 
or pyramidal neurons of layers 2 - 4, mainly layer 3. 


e (FS) Fast spiking interneurons fire high-frequency tonic spikes with relatively 
constant period. They exhibit Class 2 excitability (Tateno et al. 2004). When the 
magnitude of the injected current decreases below a certain critical value, they 
fire irregular spikes, switching randomly between resting and spiking states. Mor- 
phologically, FS neurons are sparsely spiny or aspiny nonpyramidal cells (basket 
or chandelier; see Kawaguchi and Kubota 1997) providing local inhibition along 
the horizontal (intra-laminar) direction of the neocortex (Bacci et al. 2003). 


e (LTS) Low-threshold spiking neurons fire tonic spikes with pronounced spike 
frequency adaptation and rebound (postinhibitory) spikes, often called “low- 
threshold spikes” by biologists (hence the name). They seem to be able to fire 
low-frequency spike trains, though their excitability class has not yet been deter- 
mined. Morphologically, LTS neurons are nonpyramidal interneurons providing 
local inhibition along the vertical (inter-laminar) direction of the neocortex (Bacci 
et al. 2003). 
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e (LS) Late spiking neurons exhibit voltage ramp in response to injected DC 
current near the rheobase, resulting in delayed spiking with latencies as long 
as 1 sec. There is a pronounced subthreshold oscillation during the ramp, but 
the discharge frequency is far less than that of FS neurons. Morphologically, 
LS neurons are nonpyramidal interneurons (neurogliaform; see Kawaguchi and 
Kubota 1997) found in all layers of neocortex (Kawaguchi 1995), especially in 
layer 1 (Chu et al. 2003). 


Our goal is to use the simple model (8.5, 8.6) presented in section 8.1.4 to reproduce 
each of the firing types. We want to capture the dynamic mechanism of spike generation 
of each neuron, so that the model reproduces the correct responses to many types of 
the inputs, and not only to the pulses of DC current. We strive to have not only 
qualitative but also quantitative agreement with the published data on neurons’ resting 
potential, input resistance, rheobase, F-I behavior, the shape of the upstroke of the 
action potential, and so on, though this is impossible in many cases, mostly because 
the data are contradictory. To fine-tune the model, we use recordings of real neurons. 
We consider the tuning successful when the quantitative difference between simulated 
and recorded responses is smaller than the difference between the responses of two 
“sister” neurons recorded in the same slice. We do not want to claim that the simple 
model explains the mechanism of generation of any of the firing patterns recorded in 
real neurons (simply because the mechanism is usually not known). Although in many 
instances we must resist the temptation to use the Wolfram (2002) new-kind-of-science 
criterion: “If it looks the same, it must be the same”. 


8.2.1 Regular Spiking (RS) Neurons 


Regular spiking neurons are the major class of excitatory neurons in the neocortex. 
Many are Class 1 excitable, as we show in Fig.7.3, using in vitro recordings of a layer 
5 pyramidal cell of rat primary visual cortex (see also Tateno et al. 2004). RS neurons 
have a transient K* current J,, whose slow inactivation delays the onset of the first 
spike and increases the interspike period, and a persistent K* current [,,, which is 
believed to be responsible for the spike frequency adaptation seen in Fig.7.43. Let us 
use the simple model (8.5, 8.6) to capture qualitative and some quantitative features 
of typical RS neurons. 

We assume that the resting membrane potential is v, = —60 mV and the instanta- 
neous threshold potential is v4, = —40 mV; that is, instantaneous depolarizations above 
—40 mV cause the neuron to fire, as in Fig.3.15. Assuming that the rheobase is 50 pA 
and the input resistance is 80 MQ, we find k = 0.7 and b = —2. We take the membrane 
capacitance C' = 100 pF, which yields a membrane time constant of 8 ms. 

Since b < 0, depolarizations of v decrease u as if the major slow current is the 
inactivating K* current J,. The inactivation time constant of J, is around 30 ms in 
the subthreshold voltage range; hence one takes a = 0.03 ~ 1/30. The membrane 
potential of a typical RS neuron reaches the peak value Upeak = +35 mV during a 
spike (the precise value has little effect on dynamics) and then repolarizes to c = —50 
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Figure 8.12: Comparison of in vitro recordings of a regular spiking (RS) pyramidal 
neuron with simulations of the simple model 1000 = 0.7(v + 60)(v + 40) —u+ J, 
u = 0.03{—2(v + 60) — u}, if v > +35, then v + —50, u+ ut 100. 


mV or below, depending on the firing frequency. The parameter d describes the total 
amount of outward minus inward currents activated during the spike and affecting the 
after-spike behavior. Trying different values, we find that d = 100 gives a reasonable 
F-I relationship, at least in the low-frequency range. 

As follows from exercise 10, one can also interpret wu as the membrane potential of 
a passive dendritic compartment, taken with the minus sign. Thus, when b < 0, the 
variable u represents the combined action of slow inactivation of J, and slow charging 
of the dendritic tree. Both processes slow the frequency of somatic spiking. 

Note that we round up all the parameters, that is, we use d = 100 and not 93.27. 
Nevertheless, the simulated voltage responses in Fig.8.12 agree quantitatively with the 
in vitro recordings of the layer 5 pyramidal neuron used in Fig.7.3. Tweaking the pa- 
rameters, considering multidimensional u, or adding multiple dendritic compartments, 
one can definitely improve the quantitative correspondence between the model and the 
in vitro data of that particular neuron, but this is not our goal here. Instead, we want 
to understand the qualitative dynamics of RS neurons, using the geometry of their 
phase portraits. 
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Figure 8.13: Two 
types of  qualita- 
tive behavior — of 
RS neurons. Some 
exhibit monotone 
responses to weak 
injected currents (case 
b < 0); others exhibit 
non-monotone — over- 
shooting responses 
(case b > 0). Shown 
are in vitro recordings 
of two RS neurons 
from the same slice 
of rat primary visual 
cortex while an auto- 
mated procedure was 
trying to determine 
the neurons’ rheobase. 
Phase portraits are 
drawn by hand and 
illustrate a possible 
dynamic mechanism 
of the phenomenon. 


Phase Plane Analysis 


Figure 8.13 shows recordings of two pyramidal RS neurons from the same slice while 
an automated procedure injects pulses of DC current to determine their rheobase. The 
neuron on the left exhibits monotonically increasing (ramping) or decreasing responses 
of membrane potential to weak input pulses, long latencies of the first spike, and no 
rebound spikes, whereas the neuron on the right exhibits non-monotone overshooting 
responses to positive pulses, sags and rebound spikes to negative pulses (as in Fig.7.48), 
relatively short latencies of the first spike, and other resonance phenomena. The even 
more extreme example in Fig.7.42 shows a pyramidal neuron executing a subthreshold 
oscillation before switching to a tonic spiking mode. 

The difference between the types in Fig.8.13 can be explained by the sign of the 
parameter b in the simple model (8.5, 8.6), which depends on the relative contributions 
of amplifying and resonant slow currents and gating variables. When b < 0 (or b & 0; 
e.g., b = 0.5 in Fig.8.14), the neuron is a pure integrator near saddle-node on invariant 
circle bifurcation. Greater values of b > 0 put the model near the transition from an 
integrator to a resonator the via codimension-2 Bogdanov-Takens bifurcation studied 
in section 6.3.3 and 7.2.11. 
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Figure 8.14: Saddle-node on invariant circle bifurcations in the RS neuron model as 
the magnitude of the injected current J increases. 
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Figure 8.15: The sequence of bifurcations of the RS model neuron (8.5, 8.6) in resonator 
regime. Parameters are as in Fig.8.12 and b = 5; see also Fig.6.40. 


286 Simple Models 


LS 
%. 
: 
oa 
- 
4 
3 
o) 
% 


recovery variable 


-60 mV 


membrane potential 


Figure 8.16: Stuttering behavior of an RS neuron. (Data provided by Dr. Klaus M. 
Stiefel: P28-36 adult mouse, coronal slices, 300j1m, layer II/III pyramid, visual cortex.) 


The sequence of bifurcations when b > 0 is depicted in Fig.8.15. Injection of 
depolarizing current below the neuron’s rheobase transforms the resting state into 
a stable focus and results in damped oscillations of the membrane potential. The 
attraction domain of the focus (shaded region in the figure) is bounded by the stable 
manifold of the saddle. As J increases, the stable manifold makes a loop and becomes 
a big homoclinic orbit giving birth to a spiking limit cycle attractor. When J = 125, 
stable resting and spiking states coexist, which plays an important role in explaining 
the paradoxical stuttering behavior of some neocortical neurons discussed later. As 
I increases, the saddle quantity (i.e., the sum of eigenvalues of the saddle) becomes 
positive. When the stable manifold makes another, smaller loop, it gives birth to an 
unstable limit cycle, which then shrinks to the resting equilibrium and results in a 
subcritical Andronov-Hopf bifurcation. 


What is the excitability class of the RS model neuron in Fig.8.15? If a slow ramp of 
current is injected, the resting state of the neuron becomes a stable focus and then loses 
stability via a subcritical Andronov-Hopf bifurcation. Hence the neuron is a resonator 
exhibiting Class 2 excitability. Now suppose steps of DC current of amplitude J = 125 
pA or less are injected. The trajectory starts at the initial point (v,u) = (—60,0), 
which is the resting state when J = 0, and then approaches the spiking limit cycle. 
Because the limit cycle was born via a homoclinic bifurcation to the saddle, it has 
a large period, and hence the neuron is Class 1 excitable. Thus, depending on the 
nature of stimulation, that is, ramps vs. pulses, we can observe small or large spiking 
frequencies, at least in principle. 


In practice, it is quite difficult to catch homoclinic orbits to saddles because they 
are sensitive to noise. Injection of a constant current just below the neuron’s rheobase 
in Fig.8.15 would result in random transitions between the resting state and a periodic 
spiking state. Indeed, the two attractors coexist and are near each other, so weak 
membrane noise can push the trajectory in and out of the shaded region, resulting 
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Figure 8.17: (a) Comparison of responses of a rat motor cortex layer 5 pyramidal neuron 
of RS type and the simple model (8.5, 8.6) to in vivo-like stochastic input (8.7) with 
the random conductances in (b). Part (a) is a magnification of a small region in (c). 
Shown are simulations of 300 = 3(v+55)(v+42)-—u+I(t), u = 0.01{—0.25(v+55) —u}, 
if v > +10, then v + —40, u + u+4+90. (Data provided by Niraj S. Desai and Betsy 
C. Walcott.) 


in a stuttering spiking (illustrated in Fig.8.16) mingled with subthreshold oscillations. 
Such behavior is also exhibited by FS interneurons, studied later in this section. 


In Vivo-like Conditions 


In Fig.8.17a (dashed curve) we show the response of in vitro recorded layer 5 pyramidal 
neuron of rat motor cortex to fluctuating in vivo-like input. First, random excitatory 
and inhibitory conductances, gampa(t) and gcapa(t) (Fig.8.17b), were generated using 
the Ornstein-Uhlenbeck stochastic process (Uhlenbeck and Ornstein 1930), which was 
originally developed to describe Brownian motion, but can equally well describe in 
vivo-like fluctuating synaptic conductances produced by random firings (Destexhe et 
al. 2001). Let Exypa = 0 mV and Egapa = —65 mV denote the reverse potentials of 
excitatory and inhibitory synapses, respectively. The corresponding current 


excitatory input inhibitory input 


a a 
I(t) = gampa(t)(Eampa — V(t)) + goasa(t)(Ecapa — Ve) , (8.7) 
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was injected into the neuron, using the dynamic clamp protocol (Sharp et al. 1993), 
where V(t) denotes the instantaneous membrane potential of the neuron. The same 
conductances were injected into the simple model (8.5, 8.6), whose parameters were 
adjusted to fit this particular neuron. The superimposed voltage traces, depicted in 
Fig.8.17a, show a reasonable fit. The simple model predicts more than 90 percent of 
spikes of the in vitro neuron, often with a submillisecond precision (see Fig.8.17c). Of 
course, we should not expect to get a total fit, since we do not explicitly model the 
sources of intrinsic and synaptic noise present in the cortical slice. In fact, presentation 
of the same input to the same neuron a few minutes later produces a response with 
spike jitter, missing spikes, and extra spikes (as in Fig.7.24) comparable with those in 
the simulated response. 


8.2.2 Intrinsically Bursting (IB) Neurons 


The class of intrinsically bursting (IB) neurons forms a continuum of cells that differ 
in their degree of “burstiness”, and it probably should consist of subclasses. At one 
extreme, responses of IB neurons to injected pulses of DC current have initial stereotyp- 
ical bursts (Fig.8.18a) of high-frequency spikes followed by low-frequency tonic spiking. 
Many IB neurons burst even when the current is barely superthreshold and not strong 
enough to elicit a sustained response (as in Fig.8.21, bottom traces). At the other ex- 
treme, bursts can be seen only in response to sufficiently strong current, as in Fig.8.11 
or Fig.9.1b. Weaker stimulation elicits regular spiking responses. In comparison with 
typical RS neurons, the regular spiking response of IB neurons has lower firing fre- 
quency and higher rheobase (threshold) current, and exhibits shorter latency to the 
first spike and noticeable afterdepolarizations (ADPs) (Compare RS and IB cells in 
Fig.8.11.) 

Magnifications of the responses of two IB neurons in Fig.8.18b and 8.18c¢ show 
that the interspike intervals within the burst may be increasing or decreasing, possibly 
reflecting different ionic mechanisms of burst generation and termination. In any case, 
the initial high-frequency spiking is caused by the excess of the inward current or the 
deficit of the outward current needed to repolarize the membrane potential below the 
threshold. As aresult, many spikes are needed to build up outward current to terminate 
the high-frequency burst. After the neuron recovers, it fires low-frequency tonic spikes 
because there is a residual outward current (or residual inactivation of inward current) 
that prevents the occurrence of another burst. Many IB neurons can fire two or more 
bursts before they switch into tonic spiking mode, as in Fig.8.18a. Below, we present 
two models of IB neurons, one relying on the interplay of voltage-gated currents, and 
the other relying on the interplay of fast somatic and slow dendritic spikes. 

Let us use the available data on the IB neuron in Fig.8.11 to build a simple one- 
compartment model (8.5, 8.6) exhibiting IB firing patterns. The neuron has a resting 
state at v. = —75 mV and an instantaneous threshold at vu, = —45 mV. Its rheobase 
is 350 pA, and the input resistance is around 30 MQ, resulting in k = 1.2 and b = 5. 
The peak of the spike is at +50 mV, and the after-spike resetting point is around 
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Figure 8.18: (a) bursting and spiking in an IB neuron (layer 5 of somatosensory cortex 
of a four week old rat at 35°C; (data provided by Greg Stuart and Maarten Kole). 
Note the afterdepolarization (ADP). (b) IB neuron of a cat (modified from figure 2 of 
Timofeev et al. 2000). (c) pyramidal neuron of rat visual cortex. Note that IB neurons 
may exhibit bursts with increasing or decreasing inter-spike intervals (ISIs). 


c = —56 mV. The parameters a = 0.01 and d = 130 give a reasonable fit of the 
neuron’s current-frequency relationship. 

The phase portraits in Fig.8.19 explain the mechanism of firing of IB patterns in 
the simple model. When J = 0, the model has an equilibrium at —75 mV, which 
is the intersection of the v-nullcline (dashed parabola) and the u-nullcline (straight 
line). Injection of a depolarizing current moves the v-nullcline upward. The pulse of 
current of magnitude J = 300 pA is below the neuron’s rheobase, so the trajectory 
moves from the old resting state (black square) to the new one (black circle). Since 
b > 0, the trajectory overshoots the new equilibrium. The pulse of magnitude J = 370 
pA is barely above the rheobase, so the model exhibits low-frequency tonic firing with 
some spike frequency adaptation. Elevating the fast nullcline by injecting J = 500 
pA transforms the first spike into a doublet. Indeed, the after-the-first-spike resetting 
point (white square marked “1”) is below the parabola, so the second spike is fired 
immediately. Similarly, injection of an even stronger current of magnitude J = 550 pA 
transforms the doublet into a burst of three spikes, each raising the after-spike resetting 
point. Once the resetting point is inside the parabola, the neuron is in tonic spiking 
mode. 

Figure 8.20a shows simultaneous recording of somatic and dendritic membrane po- 
tentials of a layer 5 pyramidal neuron. The somatic spike backpropagates into the 
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Figure 8.19: Comparison of in vitro recordings of an intrinsically bursting (IB) neuron 
with the simple model 1500 = 1.2(v + 75)(v + 45) —-u+TJ, & = 0.01{5(v + 75) — u}, 
if v > +50, then v + —56, u «+ u+ 130. White squares denote the reset points, 
numbered according to the spike number. 


dendrite, activates voltage-gated dendritic Nat and Ca?* currents (Stuart et al. 1999; 
Hausser et al. 2000), and results in a slower dendritic spike (clearly seen in the figure). 
The slow dendritic spike depolarizes the soma, resulting in an ADP, which is typical 
in many IB cells. Depending on the strength of the injected dc current and the state 
of the neuron, the ADP can be large enough to cause another somatic spike, as illus- 
trated in Fig.7.52. The somatic spike may initiate another dendritic spike, and so on, 
resulting in a burst in Fig.8.20b. This mechanism is known as the dendritic-somatic 
Ping-Pong (Wang 1999), and it occurs in the Pinsky-Rinzel (1994) model of the hip- 
pocampal CA3 neuron, the sensory neuron of weakly electric fish (Doiron et al. 2002), 
and in chattering neurons considered below. 

Let us build a two-compartment simple model that simulates the somatic and den- 
dritic spike generation of IB neurons. Since we do not know the rheobase, input 
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Figure 8.20: Somatic and dendritic spike (a) and burst (b) in an IB neuron. The den- 
dritic spike in (a) is simulated in (c), using the simple model described in Fig.8.21. The 
phase portrait (d) describes the geometry of the dendritic spike generation mechanism. 
Recordings are from layer 5 of the somatosensory cortex of a four-week-old rat at 35°C; 
the dendritic electrode is 0.43mm from the soma. (Data provided by Greg Stuart and 
Maarten Kole.) 


resistance, and resting and instantaneous threshold potentials of the dendritic tree of 
IB neurons, we cannot determine parameters of the dendritic compartment. Instead, 
we feed the somatic recording V(t) in Fig.8.20a into the model dendritic compartment 
and fine-tune the parameters so that the simulated dendritic spike in Fig.8.20c “looks 
like” the recorded one in Fig.8.20a. 

The phase portrait in Fig.8.20d explains the peculiarities of the shape of the sim- 
ulated dendritic spike. The recorded somatic spike quickly depolarizes the dendritic 
membrane potential from point 1 to point 2, and starts the regenerative process — the 
upstroke of a spike. Upon reaching the peak of the spike (3), the dendritic membrane 
potential and the recovery variable are reset by the action of fast voltage-gated K* 
currents, which are not modeled here explicitly. The reset point (4) is near the stable 
manifold of the saddle, so the membrane potential slowly repolarizes (5) and returns 
to the resting state (6). 

In Fig.8.21 we put the somatic and dendritic compartments together, adjust some 
of the parameters, and simulate the response of the IB neuron to pulses of current of 
various amplitudes. Note that the model correctly reproduces the transient burst of 
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Figure 8.21: Comparison of in vitro recordings of an intrinsically bursting (IB) neuron 
(layer 5 of somatosensory cortex of a four-week-old rat at 35°C; data provided by Greg 
Stuart and Maarten Kole) with the two-compartment simple model. Soma: 1500 = 
3(u + 70)(v + 45) + 50(vg — v) —-u+TJ, & = 0.01{5(v + 70) — u}, if v > +50, then 
uv —52, u + ut 240. Active dendrite: 300g = (vg + 50)? + 20(u — va) — Ua, 
Ug = 3{15(vg + 50) — ug}, if vg > +20, then vg + —20, ug — ug + 500. 


two closely spaced spikes when stimulation is weak, and the rhythmic bursting with 
decreasing number of spikes per burst when stimulation is strong. Using this approach, 
one can build models of pyramidal neurons having multiple dendritic compartments, 
as we do next. 


8.2.3. Multi-Compartment Dendritic Tree 


In Fig.8.22 we simulate an IB pyramidal neuron having 47 compartments (Fig.8.22a, 
b), each described by a simple model with parameters provided in the caption of 
the figure. Our goal is to illustrate a number of interesting phenomena that occur in 
neuronal models having active dendrites, that is, dendrites capable of generating action 
potentials. 

In Fig.8.22c we inject a current into compartment 2 on the apical dendrite to 
evoke an excitatory postsynaptic potential (EPSP) of 4 mV, which is subthreshold 
for the spike generation mechanism. This depolarization produces a current that pas- 
sively spreads to neighboring compartments, and eventually into the somatic com- 
partment. However, the somatic EPSP is much weaker, only 1 mV, reflecting the 
distance-dependent attenuation of dendritic synaptic inputs. Note also that somatic 
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Figure 8.22: (a) Hand drawing and (b) a 47-compartment representation of a layer 
5 pyramidal neuron. (c) Injection of current (simulating excitatory synaptic input) 
into compartment 2 evokes a large excitatory postsynaptic potential (EPSP) in that 
compartment, but a much smaller EPSP in the somatic compartment. (d) Synaptic 
inputs to compartments 6 and 7 result in large EPSPs there, but no dendritic spike. 
(ec) The same synaptic inputs into compartment 6 result in a dendritic spike, which 
fails to propagate forward to the soma. (f) The same input combined with background 
excitation J, = 60 pA to all compartments results in forward-propagating dendritic 
spikes. (g) Strong synaptic input to the soma results in a spike that fails to propagate 
into the dendritic tree. (h) The same input combined with injection of J, = 70 
pA to all compartments (to simulate in vivo tonic background input) promotes back- 
propagation of spike into the dendritic tree. Each compartment is simulated by the 
simple model 1000 = 3(v + 60)(v + 50) —u+J, u = 0.01{5(v + 60) — u}. Soma: if 
v > +50, then v + —55, wu ¢+ u+500. Dendrites: if v > +10, then v «+ —35, 
u«u+ 1000. The conductance between any two adjacent compartments is 70 nS. 
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EPSP is delayed and has a wider time course, which is the result of dendritic low-pass 
filtering, or smoothing, of subthreshold neuronal signals. The farther the stimulation 
site is from the soma, the weaker, more delayed, and longer lasting the somatic EPSP 
is. For many years, dendrites were thought to be passive conductors whose sole purpose 
is to collect and low-pass filter the synaptic input. 

Now, we explore the active properties of dendrites and their dependence on the 
location, timing, and strength of synaptic input. First, we stimulate two synapses that 
innervate two sister dendritic compartments, e.g., compartments 6 and 7 in Fig.8.22d 
that could interact via their mother compartment 5. Each synaptic input evokes a 
strong EPSP of 12 mV, but due to their separation, the EPSPs do not add up and no 
dendritic spike is fired. The resulting somatic EPSP is only 0.15 mV due to the passive 
attenuation. In Fig.8.22e we provide exactly the same synaptic input, but into the same 
compartment, i.e., compartment 6. The EPSPs add up, and result in a dendritic spike, 
which propagates into the mother compartment 5 and then into the sister compartment 
7 (which was not stimulated), but it fails to propagate along the apical dendrite into 
the soma. Nevertheless, the somatic compartment exhibits an EPSP of 1.5 mV, hardly 
seen in the figure. Thus, the location of synaptic stimulation, all other conditions 
being equal, made a difference. In Fig.8.22f we combine the synaptic stimulation to 
compartment 6 with injection of a weak current, J, to all compartments of the neuron. 
This current represents a tonic background excitation to the neuron that is always 
present in vivo. It depolarizes the membrane potential by 2.5 mV and facilitates the 
propagation of the dendritic spike along the apical dendrite all the way into the soma. 
The same effect could be achieved by an appropriately timed excitatory synaptic input 
arriving at an intermediate compartment, e.g., compartment 3 or 2. Not surprisingly, 
an appropriately timed inhibitory input to an intermediate compartment on the apical 
dendrite could stop the forward-propagating dendritic spike in Fig.8.22f. 

In Fig.8.22¢ and 8.22h we illustrate the opposite phenomenon — back-propagating 
spikes from soma to dendrites. A superthreshold stimulation of the somatic compart- 
ment evokes a burst of three spikes, which fails to propagate along the apical dendrites 
by itself, but can propagate if combined with a tonic depolarization of the dendritic 
tree. 

We see that dendritic trees can do more than just averaging and low-pass filtering of 
distributed synaptic inputs. Separate parts of the tree can perform independent local 
signal processing and even fire dendritic spikes. Depending on the synaptic inputs 
to other parts of the tree, the spikes can be localized or they can forward-propagate 
into the soma, causing the cell to fire. Spikes at the soma can backpropagate into the 
dendrites, triggering spike-time-dependent processes such as synaptic plasticity. 


8.2.4 Chattering (CH) Neurons 


Chattering neurons, also known as fast rhythmic bursting (FRB) neurons, generate 
high-frequency repetitive bursts in response to injected depolarizing currents. The 
magnitude of the DC current determines the interburst period, which could be as long 
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as 100 ms or as short as 15 ms, and the number of spikes within each burst, typically 

two to five, as we illustrate in Fig.8.23, using in vivo recordings of a pyramidal neuron 

of cat visual cortex. 
An RS model neuron, as shown in Fig.8.12, can easily be transformed into a CH 
neuron by increasing the after-spike reset voltage to c = —40 mV, mimicking decreased 


Kt and increased Nat currents activated during each spike. The phase portrait in 
Fig.8.24 explains the mechanism of chattering of the simple model (8.5, 8.6). A step 
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of depolarizing current shifts the fast quadratic nullcline upward and the trajectory 
quickly moves rightward to fire a spike. The after-spike reset point (white square 
marked “1” in the figure) is outside the parabola nullcline, so another spike is fired 
immediately, and so on, until the total amount of outward current is large enough to 
stop the burst; that is, until the variable u moves the reset point (the white square 
marked “5”) inside the quadratic parabola. The trajectory makes a brief excursion 
to the left knee (afterhyperpolarization) and then moves rightward again, initiating 
another burst. Since the second burst starts with an elevated value of u, it has fewer 
spikes — a phenomenon exhibited by many CH neurons. 


8.2.5 Low-Threshold Spiking (LTS) Interneurons 


Low-threshold spiking interneurons behave like RS excitatory neurons (b > 0) in the 
sense that they exhibit regular spiking patterns in response to injected pulses of current 
(some call them regular spiking non-pyramidal (RSNP) neurons). There are some 
subtle differences, however. The response of an LTS cell to a weak depolarizing current 
consists of a phasic spike or a doublet with a relatively short latency followed by low- 
frequency (less than 10 Hz) subthreshold oscillation of membrane potential. Stronger 
pulses elicit tonic spikes with slow frequency adaptation, decreasing amplitudes, and 
decreasing after-hyperpolarizations, as one can see in Fig.8.11. 

LTS neurons have more depolarized resting potentials, lower threshold potentials, 
and lower input resistances than RS neurons. To match the in vitro firing patterns 
of the LTS interneuron of rat barrel cortex in Fig.8.25, we take the simple model of 
the RS neuron and adjust the resting and instantaneous threshold potentials v, = —56 
mV and vy, = —42 mV, and the values k = 1 and b = 8, resulting in the rheobase 
current of 120 pA and the input resistance of 50 MQ. To model the decreasing nature 
of the spike and AHP amplitudes, we assume that the peak of the spike and the after- 
spike resetting point depend on the value of the recovery variable u. This completely 
unnecessary cosmetic adjustment has a mild effect on the quantitative behavior of the 
model but gives a more “realistic” look to the simulated voltage traces in Fig.8.25. 

The class of excitability of LT'S neurons has not been studied systematically, though 
the neurons seem to be able to fire periodic spike trains with a frequency as low as that 
of RS neurons (Beierlein et al. 2003; Tateno and Robinson, personal communication). 
The conjecture that they are near saddle-node on invariant circle bifurcation, and 
hence are Class 1 excitable integrators, seems to be at odds with the observation 
that their membrane potential exhibits slow damped oscillation and that they can fire 
postinhibitory rebound spikes (Bacci et al. 2003a), called low-threshold spikes (hence 
the name — LTS neurons). They are better characterized as being at the transition 
from integrators to resonators, with phase portraits as in Fig.8.15. 

A possible explanation for the subthreshold oscillations in LTS (and some RS) 
neurons is given in Fig.8.13, case b > 0. The resting state is a stable node when J = 0, 
but it becomes a stable focus when the magnitude of the injected current is near the 
neuron’s rheobase. After firing a phasic spike, the trajectory spirals into the focus 
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Figure 8.25: Comparison of in vitro recordings of a low threshold spiking (LTS) in- 
terneuron (rat barrel cortex; data provided by B. Connors) with simulations of the 
simple model 1000 = (v+56)(v+ 42) —u+ J, & = 0.03{8(v+ 56) —u}, if v > 40—0.1u, 
then v + —53+ 0.04u, wu < min{u + 20,670}. 


exhibiting damped oscillation. Its frequency is the imaginary part of the complex- 
conjugate eigenvalues of the equilibrium, and it is small because the system is near 
Bogdanov-Takens bifurcation. 


A possible explanation for the rebound spike in LTS (or some RS) neurons is given 
in Fig.8.26. The shaded region is the attraction domain of the resting state (black 
circle), which is bounded by the stable manifold of the saddle (white circle). A suffi- 
ciently strong hyperpolarizing pulse moves the trajectory to the new, hyperpolarized 
equilibrium (black square), which is outside the attraction domain. Upon release from 
the hyperpolarization, the trajectory fires a phasic spike and then returns to the rest- 
ing state. Some LTS interneurons fire bursts of spikes, and for that reason are called 
burst-spiking non-pyramidal (BSNP) neurons. 
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Figure 8.26: The mechanism of sag and rebound spike of the model in Fig.8.25. 


8.2.6 Fast Spiking (FS) Interneurons 


Fast spiking neurons fire “fast” tonic spike trains of relatively constant amplitude 
and frequency in response to depolarized pulses of current. In a systematic study, 
Tateno et al. (2004) have shown that FS neurons have Class 2 excitability in the sense 
that their frequency-current (F-I) relation has a discontinuity around 20 Hz. When 
stimulated with barely superthreshold current, such neurons exhibit irregular firing, 
randomly switching between spiking and fast subthreshold oscillatory mode (Kubota 
and Kawaguchi 1999; Tateno et al. 2004). 

The absence of spike frequency adaptation in FS neurons is mostly due to the 
fast Kt current that activates during the spike, produces deep AHP, completely dein- 
activates the Nat current, and thereby facilitates the generation of the next spike. 
Blocking the Kt current by TEA (Erisir et al. 1999) removes AHP, leaves residual 
inactivation of the Nat current, and slows the spiking, essentially transforming the FS 
firing pattern into LTS. 

The existence of fast subthreshold oscillations of membrane potential suggests that 
the resting state of the FS neurons is near the Andronov-Hopf bifurcation. Stuttering 
behavior at the threshold currents points to the coexistence of resting and spiking 
states, as in Fig.8.16, and suggests that the bifurcation is of the subcritical type. 
However, FS neurons do not fire postinhibitory (rebound) spikes — the feature used 
to distinguish them experimentally from LTS types. Thus, we cannot use the simple 
model (8.5, 8.6) in its present form to simulate FS neurons because the model with 
linear slow nullcline would fire rebound spikes according to the mechanism depicted in 
Fig.8.26. In addition, the simple model has a non-monotone I-V relation, whereas FS 
neurons have a monotone relation. 

The absence of rebound responses in FS neurons means that the phenomenological 
recovery variable (activation of the fast K+ current) does not decrease significantly 
below the resting value when the membrane potential is hyperpolarized. That is, the 
slow u-nullcline becomes horizontal in the hyperpolarized voltage range. Accordingly, 
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Figure 8.27: Comparison of in vitro recordings of a fast spiking (FS) interneuron of layer 
5 rat visual cortex with simulations of the simple model 200 = (v+55)(v +40) —u-+J, 
u = 0.2{U(v) — u}, if v > 25, then v + —45 mV. Slow nonlinear nullcline U(v) = 0 
when v < v, and U(v) = 0.025(u — up)? when v > vp, with vy, = —55 mV. Shaded area 
denotes the attraction domain of the resting state. 


we simulate the FS neuron in Fig.8.27, using the simple model (8.5) with nonlinear 
u-nullcline. 

The phase portraits and bifurcation diagram of the FS neuron model are qualita- 
tively similar to the fast subsystem of a “subHopf/fold cycle” burster: injection of DC 
current J creates a stable and an unstable limit cycle via fold limit cycle bifurcation. 
The frequency of the newborn stable cycle is around 20 Hz; hence the discontinuity 
of the F-I curve and Class 2 excitability. There is a bistability of resting and spiking 
states, as in Fig.8.27 (bottom right), so that noise can switch the state of the neuron 
back and forth, and result in irregular stuttering spiking with subthreshold oscillations 
in the 10 — 40 Hz range between the spike trains. Further increase of J shrinks the 
amplitude of the unstable limit cycle, results in the subcritical Andronov-Hopf bifur- 
cation of the resting state, removes the coexistence of attractors, and leaves only the 
tonic spiking mode. 
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Figure 8.28: Comparison of in vitro recordings of a late spiking (LS) interneuron of 
layer 1 rat neocortex with simulations of the simple two-compartment model. Soma: 
200 = 0.3(v + 66)(v + 40) + 1.2(vg—v) —u tJ, & = 0.17{5(v+ 66) — u}, if v > 30, then 
v «+ —45, u< u+ 100. Passive dendrite (dotted curve): tq = 0.01(v — va). Weak 
noise was added to simulations to unmask the subthreshold oscillations. (Recordings 
were provided by Zhiguo Chu, Mario Galarreta, and Shaul Hestrin; traces J = 125 and 
I = 150 are from one cell; trace J = 200 is from another cell.) 


8.2.7 Late Spiking (LS) Interneurons 


When stimulated with long pulses of DC current, late spiking neurons exhibit a long 
voltage ramp, barely seen in Fig.8.28 (bottom), and then switch into a tonic firing mode. 
A stronger stimulation may evoke an immediate (transient) spike followed by a long 
ramp and a long latency to the second spike. There are pronounced fast subthreshold 
oscillations during the voltage ramp, indicating the existence of at least two time scales: 
(1) fast oscillations resulting from the interplay of amplifying and resonant currents, 
and (2) slow ramp resulting from the slow kinetic of an amplifying variable, such as 
slow inactivation of an outward current (e.g., the K* A-current) or slow activation of 
an inward current, or both. In addition, the ramp could result from the slow charging 
of the dendritic compartment of the neuron. 

The exact mechanism responsible for the slow ramp in LS neurons is not known 
at present. Fortunately, we do not need to know the mechanism in order to simulate 
LS neurons using the simple model approach. Indeed, simple models with passive 
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dendrites are equivalent to simple models with linear amplifying currents. For example, 
the model in Fig.8.28 consists of a two-dimensional system (v,wu) responsible for the 
spike generation mechanism at the soma and a linear equation for the passive dendritic 
compartment vg. 

When stimulated with the threshold current (i.e., just above the neuronal rheobase), 
LS neurons often exhibit the stuttering behavior seen in Fig.8.28 (middle). Subthresh- 
old oscillations, voltage ramps, and stuttering are consistent with the following ge- 
ometrical picture. Abrupt onset of stimulation evokes a transient spike followed by 
brief hyperpolarization and then sustained depolarization. While depolarized, the fast 
subsystem affects the slow subsystem, e.g., slowly charges the dendritic tree or slowly 
inactivates the K* current. In any case, there is a slow decrease of the outward current 
or, equivalently, a slow increase of the inward current that drives the fast subsystem 
through the subcritical Andronoyv-Hopf bifurcation. Because of the coexistence of rest- 
ing and spiking states near the bifurcation, the neuron can be switched from one state 
to the other by the membrane noise. Once the bifurcation is passed, the neuron is in 
the tonic spiking mode. Overall, LS neurons can be thought of as being FS neurons 
with a slow subsystem that damps any abrupt changes, delays the onset of spiking, 
and slows the frequency of spiking. 


8.2.8 Diversity of Inhibitory Interneurons 


In contrast to excitatory neocortical pyramidal neurons, which have stereotypical mor- 
phological and electrophysiological classes (RS, IB, CH), inhibitory neocortical in- 
terneurons have wildly diverse classes with various firing patterns that cannot be 
classified as FS, LTS, or LS. Markram et al. (2004) reviewed recent results on the re- 
lationship between electrophysiology, pharmacology, immunohistochemistry, and gene 
expression patterns of inhibitory interneurons. An extreme interpretation of their find- 
ings is that there is a continuum of different classes of interneurons rather than a set 
of three classes. 
Figure 8.29 summarizes five of the most ubiquitous groups in the continuum: 


e (NAC) Non-accommodating interneurons fire repetitively without frequency adap- 
tation in response to a wide range of sustained somatic current injections. Many 
FS and LS neurons are of this type. 


e (AC) Accommodating interneurons fire repetitively with frequency adaptation 
and therefore do not reach the high firing rates of NAC neurons. Some FS and 
LS cells, but mostly LTS cells, are of this type. 


e (STUT) Stuttering interneurons fire high-frequency clusters of regular spikes 
intermingled with unpredictable periods of quiescence. Some FS and LS cells 
exhibit this firing type. 


e (BST) Bursting interneurons fire a cluster of three to five spikes riding on a slow 
depolarizing wave, followed by a strong slow AHP. 
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Figure 8.29: An alternative classification of neocortical inhibitory interneurons (mod- 
ified from Markram et al. 2004). Five major classes: non-accommodating (NAC), 
accommodating (AC), stuttering (STUT), bursting (BST), and irregular spiking (IS). 
Most classes contain subclasses: delay (d), classic (c), and burst (b). For bursting 
interneurons, the three types are repetitive (r), initial (i), and transient (t). Subclass 
d-IS is not provided in the original picture by Markram et al. 
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Figure 8.30: Simulations of the simple model with various parameters can reproduce 
all firing patterns of neocortical inhibitory interneurons in Fig.8.29. 
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e (IS) Irregular spiking interneurons fire single spikes randomly with pronounced 
frequency accommodation. 


NAC and AC are the most common response types found in the neocortex. Each group 
can be divided into three subgroups depending on the type of the onset of the response 
to a step depolarization: 


e (c) Classical response is when the first spike has the same shape as any other 
spike in the response. 


e (b) Burst response is when the first three or more spikes are clustered into a 
burst. 


e (d) Delayed response is when there is noticeable delay before the onset of spiking. 


The BST type has different subdivisions: repetitive (r), initial (i), and transient (t) 
bursting. 

In Fig.8.30 we use the simple model (8.5, 8.6) to reproduce all firing patterns of the 
interneurons, including the delayed irregular spiking (d-IS) pattern that was omitted 
from Fig.8.29. We use one-size-fits-all set of parameters: C = 100, k = 1, v, = —60 
mV, and yY = —40 mV. We vary the parameters a,b,c, and d. We do not strive to 
reproduce the patterns quantitatively, but only qualitatively. 

The parameters for the NAC and AC cells were similar to those for RS neurons, with 
an additional passive dendritic compartment for the delayed response. The parameters 
for the STUT and IS cells were similar to those of the LS interneuron, with some 
minor modifications that affect the initial burstiness and delays. Irregular stuttering 
in these types results from the coexistence of a stable resting equilibrium and a spiking 
limit cycle attractor, as in the cases of FS and LS neurons considered above. The 
level of intrinsic noise controls the probabilities of transitions between the attractors. 
The parameters for the BST cells were similar to those of IB and CH pyramidal cells. 
Varying the parameters a,b,c, and d, we indeed can get all the firing patterns in 
Fig.8.29, plus many intermediate patterns, thereby creating a continuum of types of 
inhibitory interneurons. 


8.3. Thalamus 


The thalamus is the major gateway to the neocortex in the sense that no sensory 
signal, such as vision, hearing, touch, or taste, etc., can reach the neocortex without 
passing through an appropriate thalamic nucleus. Anatomically, the thalamic system 
consists of three major types of neurons: thalamocortical (TC) neurons, which relay 
signals into the neocortex; reticular thalamic nucleus (RTN) neurons; and thalamic 
interneurons, which provide local reciprocal inhibition (Shepherd 2004). The three 
types have distinct electrophysiological properties and firing patterns. 

There are undoubtedly subtypes within each type of thalamic neurons, but the 
classification is not as elaborate as the one in the neocortex. This, and the differences 


Simple Models 305 


Figure 8.31: Compari- 


cat TC neuron simple model son of in vitro record- 


tonic mode burst mode tonic mode burst mode 


ings of a thalamocor- 
{iil tical (TC) cell of cat 
dorsal lateral genicu- 


late nucleus with sim- 


ulations of the simple 
60)(v + 50) —-ut+ ZT, 


u = 0.01{b(v+65) —u}, 


200 ms b= 15 if v < —65 and 
ULL LL b = 0 otherwise. When 
60 mv J v > 35+0.1u, then v + 


—————= — ———— —60—O0.lu, u+ u+10. 
21 — Injected current pulses 
a s are in 50 pA incre 
(oe eae /| ments. In burst mode, 
oO For sauce ieeistot es aaa aces 2 “1 the cell was hyperpolar 
o ’ 7 = 
a 4 = ra 
oO , . . 
& oo > .. 4 ized to —80 mV prior to 
> An —> 5A) ane ss 
§ -100/ — — ve 1e + injection of a depolar- 
8 | 8 ne x 4 izi ] f t 
8 £ eee “ig izing pulse of current. 
S! hyperpolarized 5 ‘ . 
moo ye State ae | (Data provided by C. 
Vo ’ 
Pal ! L v L L rd L L. Cox and S. M. Sher- 


membrane potential, v (mV) man.) 


between species, ages, and various thalamic nuclei, explain the contradictory reports 
of different firing patterns in presumably the same types of thalamic neurons. Below 
we use the simple model (8.5, 8.6) to simulate a “typical” TC, TRN, and interneuron. 
The reader should realize, though, that our attempt is as incomplete as the attempt 
to simulate a “typical” neocortical neuron ignoring the fact that there are RS, IB, CH, 
FS, and other cells. 


8.3.1 Thalamocortical (TC) Relay Neurons 


Thalamocortical (TC) relay neurons, the type of thalamic neurons that project sensory 
input to the cortex, have two prominent models of firing, illustrated in Fig.8.31: tonic 
mode and burst mode. Both modes are ubiquitous in vitro and in vivo, including 
awake and behaving animals, and both represent different patterns of relay of sensory 
information into the cortex (Sherman 2001). The transition between the firing modes 
depends on the degree of inactivation of a low-threshold Ca?* T-current (Jahnsen and 
Llinas 1984; McCormick and Huguenard 1992), which in turn depends on the holding 
membrane potential of the TC neuron. 
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In tonic mode, the resting membrane potential of a TC neuron is around —60 mV, 
which is above the inactivation threshold of the T-current. The slow Ca?* current is 
inactivated and is not available to contribute to spiking behavior. The neuron fires Nat- 
K* tonic spikes with a relatively constant frequency that depends on the amplitude of 
the injected current and could be as low as a few Hertz (Zhan et al. 1999). Such a 
cell, illustrated in Fig.8.31, is a typical Class 1 excitable system near a saddle-node on 
invariant circle bifurcation. It exhibits regular spiking behavior similar to that of RS 
neocortical neurons. It relays transient inputs into outputs, and for this reason, many 
refer to the tonic mode as the relay mode of firing. 

To switch a TC neuron into the burst mode, an injected DC current or inhibitory 
synaptic input must hyperpolarize the membrane potential to around —80 mV for at 
least 50 — 100 ms. While it is hyperpolarized, the Ca?* T-current deinactivates and 
becomes available. As soon as the membrane potential is returned to the resting or 
depolarized state, there is an excess of the inward current that drives the neuron over 
the threshold and results in a rebound burst of high-frequency spikes (as in Fig.8.31), 
called a low-threshold (LT) spike or a Ca?* spike. 

In Fig.8.31 (right) we simulate the TC neuron, using the simple model (8.5, 8.6), 
and treating u as the low-threshold Ca?* current. Since the current is inactivated in 
the tonic mode, that is, u + 0, we take b = 0. The resting and threshold voltages 
of the neuron in the figure are v, = —60 mV and y% = —50 mV. The value p = 1.6 
results in a 40 pA rheobase current and a 60 MQ input resistance, and the membrane 
capacitance C' = 200 pF gives the correct current-frequency (F-I) relationship. Thus, 
in the tonic mode, our model is essentially the quadratic integrate-and-fire neuron 
2000 = 1.6(v + 60)(v + 50) + J with the after-spike reset from +35 mV to —60 mV. 

To model slow Ca?* dynamics in the burst mode, assume that hyperpolarizations 
below the Ca?* inactivation threshold of —65 mV decrease u, thereby creating inward 
current. In the linear case, take u = 0.01{b(v +65) —u} with b = 0 when v > —65, and 
b = 15 when v < —65, resulting in the piecewise linear u-nullcline depicted in Fig.8.31 
(bottom). Prolonged hyperpolarization below —65 mV decreases u and moves the tra- 
jectory outside the attraction domain of the resting state (shaded region in the figure). 
Upon release from the hyperpolarization, the model fires a rebound burst of spikes; 
the variable u — 0 (inactivation of Ca?*), and the trajectory reenters the attraction 
domain of the resting state. Steps of depolarized current produce rebound bursts fol- 
lowed by tonic spiking with adapting frequency. A better quantitative agreement with 
TC recordings can be achieved when two slow variables, wu; and ug, are used. 


8.3.2 Reticular Thalamic Nucleus (RTN) Neurons 


Reticular thalamic nucleus (RTN) neurons provide reciprocal inhibition to TC relay 
neurons. RT'N and TC cells are similar in the sense that they have two firing modes, 
illustrated in Fig.8.32: They fire trains of single spikes following stimulation from 
resting or depolarized potentials in the tonic mode, as well as rebound bursts upon 
release from hyperpolarized potentials in the burst mode. 
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Figure 8.32: Comparison of in vitro recordings of a reticular thalamic nucleus (RTN) 
neuron of a rat with simulations of the simple model 400 = 0.25(v + 65)(v+ 45) —ut+J, 
u = 0.015{b(uv + 65) — u}, b = 10 if v < —65 and b = 2 otherwise. When v > 0 (spike 
cutoff), then v + —55, u << u+50. Injected current pulses are 50,70, and 110 pA. In 
burst mode, the cell was hyperpolarized to —80 mV prior to injection of a depolarizing 
pulse of current. (Data provided S. H. Lee and C. L. Cox.) 


The parameters of the simple model in Fig.8.32 are adjusted to match the in vitro 
recording of the RTN cell in the figure, and they differ from the parameters of the 
TC model cell. Nevertheless, the mechanism of rebound bursting of the RTN neuron 
is the same as that of the TC neuron in Fig.8.31 (bottom). In contrast, the tonic 
mode of firing is different. Since b > 0, the model neuron is near the transition from 
an integrator to a resonator; it can fire transient spikes followed by slow subthreshold 
oscillations of membrane potential; it has coexistence of stable resting and spiking 
states, with the bifurcation diagram similar to the one in Fig.8.15, and it can stutter and 
produce clustered spikes when stimulated with barely threshold current. Interestingly, 
similar behavior of TC neurons was reported by Pirchio et al. (1997), Pedroarena 
and Llinas (1997), and Li et al. (2003). We will return to the issue of subthreshold 
oscillations and stuttering spiking when we consider stellate cells of entorhinal cortex 
in section 8.4.4. 
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8.3.3. Thalamic Interneurons 


In contrast to TC and RTN neurons, thalamic interneurons do not have a prominent 
burst mode, though they can fire rebound spikes upon release from hyperpolarization 
(Pape and McCormick 1995). They have action potentials with short duration, and 
they are able to generate high-frequency trains of spikes reaching 800 Hz, as do cortical 
FS interneurons. The simple model in Fig.8.33 reproduces all these features. Its phase 
portrait and bifurcation diagram are similar to those in Fig.8.15, but its dynamics has 
a much faster time scale. 


8.4 Other Interesting Cases 


The neocortical and thalamic neurons span an impressive range of dynamic behavior. 
Many neuronal types found in other brain regions have dynamics quite similar to some 
of the types discussed above, while many do not. 


8.4.1 Hippocampal CA1 Pyramidal Neurons 


Hippocampal pyramidal neurons and interneurons are similar to those of the neocortex, 
and hence could be simulated using the simple model presented in section 8.2. Let us 
elaborate, using the pyramidal neurons of the CA1 region of the hippocampus as an 
example. 

Jensen et al. (1994) suggested classifying all CA1 pyramidal neurons according 
to their propensity to fire bursts of spikes, often called complex spikes. The majority 
(more than 80 percent) of CA1 pyramidal neurons are non-bursting cells, whereas the 
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Figure 8.34: Classification of hippocampal CA1 pyramidal neurons. A-—E, in vitro 
recordings from five different pyramidal neurons arranged according to a gradient of 
increasing propensity to burst. The neurons were stimulated with current pulses of 200 
ms duration and amplitude 50 pA and 100 pA (a), or brief (3-5 ms) superthreshold 
pulses (b). The non-burster (NB) neuron fires tonic spikes in response to long pulses 
and a single spike in response to brief pulses. The high-threshold burster (HTB) fires 
bursts only in response to strong long pulses, and single spikes in response to weak or 
brief pulses. The grade I low-threshold burster (LTB I) generates bursts in response to 
long pulses of current, but single spikes in response to brief pulses. The grade I] LTB 
(LTB II) fires bursts in response to both long (a) and brief (b) current pulses. The 
grade II] LTB (LTB III), in addition to firing bursts in response to long and brief pulses 
of current (not shown), also fires spontaneous rhythmic bursts, shown in contracted 
and expanded time scales. (Reproduced from Su et al. 2001 with permission.) 


remaining ones exhibit some form of bursts, which are defined in this context as sets 
of three or more closely spaced spikes. There are five different classes: 


e (NB) Non-bursting cells generate accommodating trains of tonic spikes in re- 
sponse to depolarizing pulses of DC current, and a single spike in response to a 
brief superthreshold pulse of current, as in Fig.8.34A. 


e (HTB) High-threshold bursters fire bursts only in response to strong long pulses 
of current, but fire single spikes in response to weak or brief pulses of current, as 
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Figure 8.35: Simulations of hippocampal CA1 pyramidal neurons (compare with 
Fig.8.34) using simple model 500 = 0.5(v+60)(v+45)—u+TJ, u = 0.02{0.5(v+60) —u}. 
When v > 40 (spike cutoff), v + c and u + u+d. Here c = —50, —45, —40, -35 mV 
and d = 50, 50, 55,60 for A—D, respectively. Parameters in E are the same as in D, but 
J = 33 pA, 


in Fig.8.34B. 


e (LTB I) Grade I low-threshold bursters fire bursts in response to long pulses, but 
single spikes in response to brief pulses of current, as in Fig.8.34C. 


e (LTB IJ) Grade II low-threshold bursters fire stereotypical bursts in response to 
brief pulses, as in Fig.8.34D. 


e (LTB III) Grade II low-threshold bursters fire rhythmic bursts spontaneously, 
which are depicted in Fig.8.34E, using two time scales. 


NB neurons are equivalent to neocortical pyramidal neurons of the RS type, whereas 
HTB and LTB I neurons are equivalent to neocortical pyramidal neurons of the IB 
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type. The author is not aware of any systematic studies of the ability of IB neurons 
to fire stereotypical bursts in response to brief pulses, as in Fig.8.34Db, or to have 
intrinsic rhythmic activity, as in Fig.8.34E. Therefore, it is not clear whether there are 
any analogues of LTB grades II and III neurons in the neocortex. 

The classification of hippocampal CA1 pyramidal neurons into five different classes 
does not imply a fundamental difference in the ionic mechanism of spike generation, but 
only a quantitative difference. This follows from the observation that pharmacological 
manipulations can gradually and reversibly transform an NB neuron into an LTB III 
neuron, and vice versa, by elevating the extracellular concentration of Kt (Jensen et al. 
1994), reducing extracellular Ca?+ (Su et al. 2001), blocking the Kt M-current (Yue 
and Yaari 2004), or manipulating Ca?+ current dynamics in apical dendrites (Magee 
and Carruth 1999). 

In Fig.8.35 we modify the simple model for the neocortical RS neuron to reproduce 
firing patterns of hippocampal pyramidal cells. To get the continuum of responses from 
NB to LTB II, fix all the parameters and vary only the after-spike reset parameter c 
by an increment of 5 mV, and the parameter d. These phenomenological parameters 
describe the effect of high-threshold inward and outward currents activated during each 
spike and affecting the after-spike behavior. Increasing c corresponds to up-regulating 
slow Ina,» or down-regulating slow Kt currents, which leads to transition from NB 
to LTB III in the CAI slice (Su et al. 2001) and in the simple model in Fig.8.35. 
Interestingly, the same procedure results in transitions from RS to IB and possibly to 
CH classes in neocortical pyramidal neurons (Izhikevich 2003). This is consistent with 
the observation by Steriade (2004) that many neocortical neurons can change their 
firing classes in vivo, depending on the state of the brain. 


8.4.2 Spiny Projection Neurons of Neostriatum and Basal 
Ganglia 


Spiny projection neurons, the major class of neurons in neostriatum and basal ganglia, 
display a prominent bistable behavior in vivo, shown in Fig.8.36 (Wilson and Groves 
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Figure 8.36: Neostriatal spiny neurons have two-state behavior in vivo. (Data provided 
by Charles Wilson.) 
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Figure 8.37: Comparison of in vitro recordings of a rat neostriatal spiny projection 
neuron with simulations of the simple model 500 = (v + 80)(v + 25) —u+TJ, u = 
0.01{—20(v+ 80) —u}, if v > 40, then v + —55, wu u+150. (In vitro data provided 
by C. Wilson.) 


1981; Wilson 1993): they shift the membrane potential from hyperpolarized to depo- 
larized states in response to synchronous excitatory synaptic input from cortex and/or 
thalamus. In vitro studies of such neurons reveal a slowly inactivating K+ A-current, 
which is believed to be responsible for the maintenance of the up-state and down-state, 
in addition to the synaptic input. Indeed, the K* current is completely deinactivated 
at the hyperpolarized potentials (down-state), and reduces the response of the neuron 
to any synaptic input. In contrast, prolonged depolarization (up-state) inactivates the 
current and makes the neuron more excitable and ready to fire spikes. 


The most remarkable feature of neostriatal spiny neurons is depicted in Fig.8.37. 
In response to depolarizing current pulses, the neurons display a prominent slowly 
depolarizing (ramp) potential, and hence long latency to spike discharge (Nisenbaum 
et al. 1994). The ramp is mostly due to the slow inactivation of the Kt A-current and 
slow charging of the dendritic tree. The delay to spike can be as long as 1 sec, but the 
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subsequent spike train has a shorter, relatively constant period that depends on the 
magnitude of the injected current — a feature consistent with the saddle-node off limit 
cycle bifurcation. 


Let us use the simple model (8.5, 8.6) to simulate the responses of spiny neurons to 
current pulses. The resting membrane potential of the neuron in Fig.8.37 is around v, = 
—80 mV, and we set 4, = —25 mV, p = 1, and b = —20 to get 30 MQ input resistance 
and 300 pA rheobase current. We take a = 0.01 to reflect the slow inactivation of the 
kt A-current in the subthreshold voltage range. The membrane potential in the figure 
reaches the peak of +40 mV during the spike and then resets to —55 mV or lower, 
depending on the firing frequency. The value d = 150 provides a reasonable match 
of the interspike frequencies for all magnitudes of injected current. Note that b < 0, 
so u represents either slow inactivation of J, or slow charging of the passive dendritic 
compartment, or both. In any case, it is a slow amplifying variable, which is consistent 
with the observation that spiny neurons do not “sag” in response to hyperpolarizing 
current pulses, do not “peak” in response to depolarizing pulses (Nisenbaum et al. 
1994), and do not generate rebound (postinhibitory) spikes. 


Injection of a depolarizing current shifts the v-nullcline of the simple model upward, 
and the resting state disappears via saddle-node bifurcation. The trajectory slowly 
moves through the ghost of the bifurcation point (shaded rectangle in the figure), 
resulting in the long latency to the first spike. The spike resets the trajectory to a point 
(white square) below the ghost, resulting in significantly smaller delays to subsequent 
spikes. Because the resetting point is so close to the saddle-node bifurcation point, 
the simple model, and probably the spiny projection neuron in the figure, are near the 
codimension-2 saddle-node homoclinic orbit bifurcation discussed in section 6.3.6. 


8.4.3. Mesencephalic V Neurons of Brainstem 


The best examples of resonators with fast subthreshold oscillations, Class 2 excitability, 
rebound spikes, and so on, are mesencephalic V (mesV) neurons of the brainstem (Wu 
et al. 2001) and primary sensory neurons of the dorsal root ganglion (Amir et al. 2002; 
Jian et al. 2004). MesV neurons of the brainstem have monotone I-V curves, whereas 
the simple model with linear equation for u does not. In Fig.8.38 we use a modification 
of the simple model to simulate the responses of a mesV neuron (data from Fig.7.3) to 
pulses of depolarizing current. 


The model’s phase portrait is qualitatively similar to that of the FS interneurons in 
Fig.8.27. The resting state is a stable focus, resulting in damped or noise-induced sus- 
tained oscillations of the membrane potential. Their amplitude and frequency depend 
on J and can be larger than 5 mV and 100 Hz, respectively. The focus loses stability 
via subcritical Andronov-Hopf bifurcation. Because of the coexistence of the resting 
and spiking states, the mesV neuron can burst, and so can the simple model if noise 
or a slow resonant variable is added. 
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Figure 8.38: Comparison of in vitro recordings of rat brainstem mesV neuron (from 
Fig.7.3) with simulations of the simple model 250 = (v + 50)(u+ 30) —-u+J/, u = 
0.5{U(v + 50) — u}, with cubic slow nullcline U(x) = 25x + 0.0092°. If v > 10, then 
v + —AO0. 


8.4.4 Stellate Cells of Entorhinal Cortex 


The entorhinal cortex occupies a privileged anatomical position that allows it to gate 
the main flow of information into and out of the hippocampus. in vitro studies show 
that stellate cells, a major class of neurons in the entorhinal cortex, exhibit intrinsic 
subthreshold oscillations with a slow dynamics of the kind shown in Fig.8.39b (Alonso 
and Llinas 1989; Alonso and Klink 1993; Klink and Alonso 1993; Dickson et al. 2000). 
The oscillations are generated by the interplay between a persistent Na* current and 
an h-current, and they are believed to set the theta rhythmicity in the entorhinal- 
hippocampal network. 

The caption of Fig.8.39 provides parameters of the simple model (8.5, 8.6) that 
captures the slow oscillatory dynamics of an adult rat entorhinal stellate cell recorded 
in vitro. The cell sags to injected hyperpolarizing current in Fig.8.39a and then fires a 
rebound spike upon release from hyperpolarization. From a neurophysiological point of 
view, the sag and the rebound response are due to the opening of the h-current; from 
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Figure 8.39: Comparison of in vitro recordings of stellate neurons of rat entorhinal 


cortex with simulations of the simple model 2000 


= 0.75(v + 60)(v + 45) —ust J, 


u = 0.01{15(v + 60) — u}, if v > 30, then v + —50. (a) Responses to steps of 
DC current. (b) Subthreshold oscillations and occasional spikes at various levels of 
injected DC current. (c) Phase portraits corresponding to two levels of injected DC 
current. Weak noise was added to simulations to unmask subthreshold oscillations. 
(Data provided by Brian Burton and John A. White. All recordings are from the same 
neuron, except steps of —500 pA and 200 pA were recorded from a different neuron. 


Spikes are cut at 0 mV.) 
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a theoretical point of view, they are caused by the resonant slow variable u, which 
could also describe deinactivation of a transient Na* current and deactivation of a 
low-threshold Kt current. The geometrical explanation of these responses is similar to 
the one provided for LTS interneurons in Fig.8.26. Positive steps of current evoke a 
transient or a sustained spiking activity. Note that the first spike is actually a doublet 
in the recording and in the simulation in Fig.8.39a (J = 200 pA). 

Stellate cells in the entorhinal cortex of adult animals can exhibit damped or sus- 
tained subthreshold oscillations in a frequency range from 5 to 15 Hz. The oscillations 
can be seen clearly when the cell is depolarized by injected DC current, as in Fig.8.39b. 
The stronger the current, the higher the amplitude and frequency of oscillations, which 
occasionally result in spikes or even bursts of spikes (Alonso and Klink 1993). The sim- 
ple model also exhibits slow damped oscillations because its resting state is a stable 
focus. The focus loses stability via subcritical Andronov-Hopf bifurcation, and hence it 
coexists with a spiking limit cycle. To enable sustained oscillations and random spikes, 
we add channel noise to the v-equation (White et al. 2000). 

In Fig.8.39c we explain the mechanism of random transitions between subthreshold 
oscillations and spikes, which is similar to the mechanism of stuttering in RS and 
FS neurons. When weak DC current is injected (left), the attraction domain of the 
resting state (shaded region) is separated from the rest of the phase space by the stable 
manifold to the saddle equilibrium (denoted separatrix). Noisy perturbations evoke 
small, sustained noisy oscillations around the resting state with an occasional spike 
when the separatrix is crossed. Increasing the level of injected DC current results in the 
series of bifurcations similar to those in Fig.8.15. As a result, there is a coexistence of a 
large amplitude (spiking) limit cycle attractor and a small unstable limit cycle, which 
encompasses the attraction domain of the resting state (right). Noisy perturbations 
can randomly switch the activity between these attractors, resulting in the random 
bursting activity in Fig.8.39b. 


8.4.5 Mitral Neurons of the Olfactory Bulb 


Mitral cells recorded in slices of rat main olfactory bulb exhibit intrinsic bistability of 
membrane potentials (Heyward et al. 2001). They spontaneously alternate between 
two membrane potentials separated by 10 mV: a relatively depolarized (up-state) and 
hyperpolarized (down-state). The membrane potential can be switched between the 
states by a brief depolarizing or hyperpolarizing pulse of current, as we show in Fig.7.36. 
In response to stimulation, the cells are more likely to fire in the up-state than in the 
down-state. 

Current-voltage (I-V) relations of such mitral cells have three zeros in the sub- 
threshold voltage range confirming that there are three equilibria: two stable ones 
corresponding to the up-state and the down-state, and one unstable, the saddle. There 
are no subthreshold oscillations in the down-state, hence it is a node, and the cell is 
an integrator. There are small-amplitude 40 Hz oscillations in the up-state; hence it is 
a focus, and the cell is a resonator. 
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Figure 8.40: Comparison of in vitro recordings of mitral neurons of rat olfactory bulb 
with simulations of the simple two-compartment model. Soma: 400 = (v+55)(v+50)+ 
0.5(vg—v)—utI, u = 0.4{(U(v) —u} with U(v) = 0 when v < vw and U(v) = 20(v—v») 
when v > vu, = —48 mV. If v > 35, then v + —50. Passive dendrite (dotted curve): 
Uq = 0.0125(v — vg). Weak noise was added to simulations to unmask subthreshold 
oscillations in the up-state. The membrane potential of the neuron is held at —75 
mV by injecting a strong negative current, and then stimulated with steps of positive 
current. (Data provided by Philip Heyward.) 


To model the bistability, we use the simple model with a piecewise linear slow 
nullcline that approximates nonlinear activation functions n.,(v) near the “threshold” 
of the current and a passive dendritic compartment. In many respects, the model is 
similar to the one for late spiking (LS) cortical interneurons. In Fig.8.40 we fine-tune 
the model to simulate responses of a rat mitral cell to pulses of current of various 
amplitudes. To prevent noise-induced spontaneous transitions between the up-state 
and the down-state, the cell in the figure was held at —75 mV by injection of a large 
negative current. Its responses to weak positive pulses of current show a fast-rising 
phase followed by an abrupt step (arrow in the figure) to a constant value corresponding 
to the up-state. Increasing the magnitude of stimulation elicits trains of spikes with 
a considerable latency whose cause has yet to be determined experimentally. The 
latency could be the result of slow activation of an inward current, slow inactivation 
of an outward current (e.g., the K* A-current), or just slow charging of the dendritic 
compartment. All three cases correspond to an additional slow variable in the simple 
model, which we interpret as a membrane potential of a passive dendritic compartment. 
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Figure 8.41: Voltage responses of a rat mitral cell and a simple model from Fig.8.40 
at two different values of the holding current. Right: Phase portraits of somatic com- 
partments show coexistence of stable node (down-state) and stable focus (up-state) 
equilibria. Spikes are emitted only from the up-state. 


To understand the dynamics of the simple model, and hopefully of the mitral cell, 
we simulate its responses in Fig.8.41 to the activation of the olfactory nerve (ON). At 
the top of Fig.8.41, the cell is held at J = 0 pA. Its phase portrait clearly shows the 
coexistence of a stable node and focus equilibria separated by a saddle. The shaded 
region corresponds to the attraction domain of the focus equilibrium. To fire a spike 
from the up-state, noise or external stimulation must push the state of the system from 
the shaded region over the threshold to the right. The cell returns to the down-state 
immediately after the spike. Much stronger stimulation is needed to fire the cell from 
the down-state. Typically, the cell is switched to the up-state first, spends some time 
oscillating at 40 Hz, and then fires a spike (Heyward et al. 2001). 


At the bottom of Fig.8.41, the cell is held at a slightly depolarizing current J = 
7 pA. The node equilibrium disappears via saddle-node bifurcation, so there is no 
down-state, but only its ghost. Stimulation at the up-state results in a spike, after- 
hyperpolarization, and slow transition through the ghost of the down-state back to 
the up-state. Further increasing the holding current results in the stable manifold to 
the upper saddle (marked “threshold” in the figure) making a loop, then becoming a 
homoclinic trajectory to the saddle, giving birth to an unstable limit cycle which shrinks 
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to the focus and makes it lose stability via subcritical Andronov-Hopf bifurcation. 
Note that this phase portrait and the bifurcation scenario are different from the one 
in Fig.7.36. However, in both cases, the neuron is an integrator in the down-state and 
a resonator in the up-state! The same property is exhibited by cerebellar Purkinje 
cells (see Fig.7.37), and possibly by other neurons kept in the up-state (intrinsically or 
extrinsically). 


Review of Important Concepts 


e An integrate-and-fire neuron is a linear model having a stable node 
equilibrium, an artificial threshold, and a reset. 


A resonate-and-fire neuron is a linear model having a stable focus 
equilibrium, an artificial threshold, and a rest. 


Though technically not spiking neurons, these models are useful for 
analytical studies, that is, to prove theorems. 


The quadratic integrate-and-fire model captures the nonlinearity of 
the spike generation mechanism of real neurons having Class 1 ex- 
citability (saddle-node on invariant circle bifurcation). 


Its simple extension, model (8.5, 8.6), quantitatively reproduces sub- 
threshold, spiking, and bursting activity of all known types of corti- 
cal and thalamic neurons in response to pulses of DC current. 


The simple model makes testable hypotheses on the dynamic mech- 
anisms of excitability in these neurons. 


The model is especially suitable for simulations of large-scale models 
of the brain. 


Bibliographical Notes 


Many people have used the integrate-and-fire neuron, treating it as a folklore model. It 
was Tuckwell’s Introduction to Theoretical Neurobiology (1988) that gave appropriate 
credit to its inventor, Lapicque (1907). Although better models, such as the quadratic 
integrate-and-fire model, are available now, many scientists continue to favor the leaky 
integrate-and-fire neuron mostly because of its simplicity. Such an attitude is under- 
standable when one wants to derive analytical results. However, purely computational 
papers can suffer from using the model because of its weird properties, such as the 
logarithmic F-I curve and fixed threshold. 
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Figure 8.42: Louis Lapicque, the discoverer of the 
integrate-and-fire neuron. 


The resonate-and-fire model was introduced by Izhikevich (2001a), and then by 
Richardson, Brunel, and Hakim (2003) and Brunel, Hakim, and Richardson (2003). 
These authors initially called the model “resonate-and-fire” , but then changed its name 
to “generalized integrate-and-fire” (GIF), possibly to avoid confusion. 

A better choice is the quadratic integrate-and-fire neuron in the normal form (8.2) 
or in the J-form (8.8); see exercise 7. The J-form was first suggested in the context of 
circle/circle (parabolic) bursting by Ermentrout and Kopell (1986a,b). Later, Ermen- 
trout (1996) used this model to generalize numerical results of Hansel et al. (1995) on 
synchronization of Class 1 excitable systems, discussed in chapter 10. Hoppensteadt 
and Izhikevich (1997) introduced the canonical model approach, provided many ex- 
amples of canonical models, and proved that the quadratic integrate-and-fire model 
is canonical in the sense that all Class 1 excitable systems can be transformed into 
this model by a piecewise continuous change of variables. They also suggested calling 
the model the “Ermentrout-Kopell canonical model” to honor its inventors, but most 
scientists follow Ermentrout and call it the “theta-neuron” . 

The model presented in section 8.1.4 was first suggested by Izhikevich (2000a; equa- 
tions (4) and (5), with voltage reset discussed in Sect. 2.3.1) in the v-form. The form 
presented here first appeared in Izhikevich (2003). The representation of the function 
I +v? in the form (v — v,)(v — v;) was suggested by Latham et al. (2000). 

We stress that the simple model is useful only when one wants to simulate large- 
scale networks of spiking neurons. He or she still needs to use the Hodgkin-Huxley-type 
conductance-based models to study the behavior of one neuron or a small network of 
neurons. The parameter values that match firing patterns of biological neurons pre- 
sented in this chapter are only educated guesses (the same is true for conductance-based 
models). More experiments are needed to reveal the true spike generation mechanism 
of any particular neuron. An additional insight into the question, “which model is 
more realistic?” is in Fig.1.8. 

Looking at the simple model, one gets an impression that the spike generation 
mechanism of RS neurons is the simplest in the neocortex. This is probably true; 
however, the complexity of the RS neurons, most of which are pyramidal cells, is hidden 
in their extensive dendritic trees having voltage- and Ca?+-gated currents. Dendritic 
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dynamics is a subject for a 500-page book by itself, and we purposely omitted it. An 
interested reader is recommended to study Dendrites by Stuart et al. (1999), recent 
reviews by Hausser and Mel (2003) and Williams and Stuart (2003), and the seminal 
paper by Arshavsky et al. (1971; Russian language edition, 1969). 


Exercises 


1. (UIntegrate-and-fire network) The simplest implementation of a pulse-coupled integ- 
rate-and-fire neural network has the form 


V; = bj —u,+ S > cigd(t = i) ‘i 
Ft 
where t; is the moment of firing of the jth neuron, that is, the moment v,(t;) = 
1. Thus, whenever the jth neuron fires, the membrane potentials of the other 
neurons are instantaneously adjusted by cj, 74 j. Show that the same initial 
conditions may result in different solutions, depending on the implementation 
details. 


2. (Latham et al. 2000) Determine the relationship between the normal form for 
saddle-node bifurcation (6.2) and the equation 


V= a(V <> Ves) (V — Vinresh ) : 


3. Show that the period of oscillations in the quadratic integrate-and-fire model 


(8.2) is 
1 Upeak ce 
T = —|[ atan 7 — atan 
Vb ( vb vb 


when 6 > 0. 


4. Show that the period of oscillations in the quadratic integrate-and-fire model 
(8.2) with Upeak = 1 is 


Te it ina lo] 1 veeset = |b| 
2¥y [D| 1+ V |D| Ureset FY [D| 
when b < 0 and Ureset > /{O]- 


5. Justify the bifurcation diagram in Fig.8.3. 


6. Brizzi et al. (2004) have shown that shunting inhibition of cat motoneurons 
raises the firing threshold, and the rheobase current, and shifts the F-I curve to 
the right without changing the shape of the curve. Use the quadratic integrate- 
and-fire model to explain the effect. (Hint: Consider ) = b— gu + v? with g > 0, 
Ureset = —OO, aNd Vpeak = +00.) 
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10. 


Lt; 


12, 


13. 


14. 


15. 
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. (Theta neuron) Determine when the quadratic integrate-and-fire neuron (8.2) is 


equivalent to the theta neuron 


0 = (1—cos?)+ (1+ cos¥)r, (8.8) 


where r is the bifurcation parameter and J € |[—7,7] is a phase variable on the 
unit circle. 


. (Another theta neuron) Show that the quadratic integrate-and-fire neuron (8.2) 


is equivalent to 
9 =0? +(1—|03|)?r. 


where J € [—1,1] and r have the same meaning as in exercise 7. Are there any 
other “theta-neurons” ? 


. When is the linear version of (8.3, 8.4), 


v= I-v-u ily. then 
au = a(bv—u) veO0,ucutd, 


equivalent to the integrate-and-fire or resonate-and-fire model? 


Show that the simple model (8.3, 8.4) with b < 0 is equivalent to the quadratic 
integrate-and-fire neuron with a passive dendritic compartment. 


All membrane potential responses in Fig.8.8 were obtained using model (8.3, 8.4) 
with appropriate values of the parameters. Use MATLAB to experiment with 
the model and reproduce the figure. 


Simulate the F'S spiking neuron in Fig.8.27, using the simple model (8.5, 8.6) with 
linear equation for u. What can you say about its possible bifurcation structure? 


Fit the recordings of the RS neuron in Fig.8.12, using the model 


Cy. = I—g(v—v,) + pv — %)% — u ih = Dees, then 
au = a(b(u—v,) —u) vecucurtd, 


where 1 = x when x > 0 and x, = 0 when otherwise. This model better fits 
the upstroke of the action potential. 


Explore numerically the model (8.3, 8.4) with a nonlinear after-spike reset v <— 
f(u),u < g(u), where f and g are some functions. 


[M.S.] Analyze the generalization of the system (8.3, 8.4) 


= [+v’+evu-u ifv=1, then 
au = a(bv—u) vecutcutd 


where e is another parameter. 
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16. [M.S.] Analyze the generalization of the following system, related to the expo- 
nential integrate-and-fire model 


= [—v+ke’—u ifv=1, then 
a(bv — u) vecucutd 


where k is another parameter. 
17. [M.S.] Analyze the system 


= I[-vt+kvi-u ifv=1, then 
a(bv — u) vecutcutd 


where v, = v when v > 0 and v, = 0 otherwise. 


18. [M.S.] Find an analytical solution to the system (8.3, 8.4) with time-dependent 
input J = I(t). 


19. [M.S.] Determine the complete bifurcation diagram of the system (8.3, 8.4). 


Chapter 9 


Bursting 


A burst is two or more spikes followed by a period of quiescence. Neurons can fire 
single spikes or stereotypical bursts of spikes, depending on the nature of stimulation 
and the intrinsic neuronal properties. Typically, bursting occurs due to the interplay 
of fast currents responsible for spiking activity and slow currents that modulate the 
activity. In this chapter we study this interplay in detail. 

To understand the geometry of bursting, it is customary to assume that the fast and 
slow currents have drastically different time scales. In this case we can dissect a burster, 
that is, freeze its slow currents and use them as parameters that control the fast spiking 
subsystem. During bursting, the slow parameters drive the fast subsystem through 
bifurcations of equilibria and limit cycles. We provide a topological classification of 
bursters based on these bifurcations, and show that different topological types have 
different neurocomputational properties. 


9.1 Electrophysiology 


Many spiking neurons can exhibit bursting activity if manipulated, for instance, phar- 
macologically. In Fig.9.1 we depict a few well-known examples of neurons that burst 
under natural conditions without any manipulation. Some require an injected DC cur- 
rent to bias the membrane potential, while others do not. One can only be amazed 
by the diversity of bursting patterns and time scales. In this chapter we consider 
electrophysiological and bifurcation mechanisms responsible for the generation of these 
patterns. 

Is a zebra a black animal with white stripes or a white animal with black stripes? 
This seemingly silly question is pertinent to every bursting pattern: Does bursting 
activity correspond to an infinite period of quiescence interrupted by groups of spikes, or 
does it correspond to an infinite spike train interrupted by short periods of quiescence? 
Biologists are mostly concerned with the question of what makes the neuron fire the 
first spike in a burst and what keeps it in the spiking regime afterward. The question 
of why the spiking stops is often forgotten. It turns out that to fully understand the 
ionic mechanism of bursting, we need to concentrate on the second question, that is, we 
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Figure 9.1: Examples of intrinsic bursters. (a) and (b) cat primary visual cortical 
neurons (modified from Nowak et al. 2003). (c) cortical neuron in anesthetized cat 
(modified from Timofeev et al. 2000). (d) thalamic reticular (RE) neuron (modified 
from Steriade 2003). (e) Cat thalamocortical relay neuron (modified from McCormick 
and Pape 1990). (f) CA1 pyramidal neuron exhibiting grade II low-threshold bursting 
pattern (modified from Su et al. 2001). (g) respiratory neuron in the pre-Botzinger 
complex (modified from Butera et al. 1999). (h) Trigeminal interneuron from rat 
brainstem (modified from Del Negro et al. 1998). 
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Figure 9.2: Is bursting a spiking state interrupted by periods of quiescence, or is it a 
quiescent state interrupted by groups of spikes? 
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Figure 9.3: Forced bursting in the Jy, »+Jx-model with parameters as in Fig.4.la and 
time-dependent injected current I(t). 


need to treat bursting as an infinite spike train that is chopped into short bursts by a 
slow (resonant) current that builds up during the spiking phase and recovers during the 
quiescent phase. Before proceeding to a general case, let us consider a simple example. 


9.1.1 Example: The TNapt+lIk+1k(my-Model 


Any model neuron capable of spiking can also burst, as, for instance, the Ina py+lk- 
model in Fig.9.3. However, this example is not interesting because the neuron is forced 
to burst by the time-dependent input I(t). 

In contrast, a modification of the INa,»+/«-model in Fig.9.4 fires a burst of spikes 
in response to a brief pulse of current. The first spike in the burst is caused by the 
stimulation, whereas the subsequent spikes are generated autonomously due to the 
intrinsic properties of the neuron, and they outlast the stimulation. Such a burst is 
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Figure 9.4: Intrinsic bursting in the INapyt+J«K+Jkimy-model (7.1), consisting of the 
Ixap+1x-model with parameters as in Fig.4.la, and a fast Kt current (gx = 9,7(V) = 
0.152) and a slow K* current with gsiow = 5, Vis2 = —20 mV, k = 5 mV, and Teiow(V) = 
20 ms. (a) Burst excitability when J = 0. (b) Periodic bursting when J = 5. 


stereotypical and fairly independent of the amplitude or the duration of the pulse that 
triggered it. 

To make the INapt+/«k-model burst, we took parameters as in Fig.6.7a, so that there 
is a coexistence of the resting and spiking states. The brief pulse of current excites the 
neuron, that is, moves its state into the attraction domain of the spiking limit cycle 
and initiates periodic activity. Without any other modification, the model will produce 
an infinite spike train. To stop the train, we added a slower high-threshold persistent 
Kt current similar to Ixqmy that provides a negative feedback. This M-current is 
not activated at rest. However, during the active (spiking) phase, the current slowly 
activates, as indicated by the slow buildup of its gating variable ngjow in the figure. The 
neuron becomes less and less excitable, and eventually cannot sustain spiking activity. 
If, instead of a pulse of current, a constant current is applied, the neuron can burst 
periodically, as in Fig.9.4b. 

This model presents only one of many possible examples of bursters, which we study 
in this chapter. However, it illustrates a number of important issues common to all 
bursters. For instance, in contrast to the forced bursting in Fig.9.3, this bursting is 
intrinsic or autonomous. This stereotypical bursting pattern results from the intrinsic 
voltage-sensitive currents, and not from a time-dependent input. The behavior in 
Fig.9.4a is called burst excitability to emphasize that the model is an excitable system, 
with the exception that superthreshold stimulation elicits a burst of spikes instead of 
a single spike. Hippocampal pyramidal neurons that are “grade III bursters”, depicted 
in Fig.8.34Eb, exhibit burst excitability. 
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Figure 9.5: Basic characteristics of bursting dynamics. 


Biologists sometimes refer to the bursting in Fig.9.4b as conditional, because repet- 
itive bursting occurs when a certain condition is satisfied, for instance, positive I is 
injected. From a mathematical point of view, every burster is conditional, since it 
exists for some values of the parameters but not for others. 


9.1.2 Fast-Slow Dynamics 


In general, every bursting pattern consists of oscillations with two time scales: a fast 
spiking oscillation within a single burst (intraburst oscillation, or spiking), and one 
modulated by a slow oscillation between the bursts (interburst oscillation); see Fig.9.5. 
Typically, though not necessarily (see exercises at the end of this chapter), two time 
scales result from two interacting processes involving fast and slow currents. For exam- 
ple, the spiking in Fig.9.4 is generated by the fast INap»+Jk-subsystem and modulated 
by the slow I qvy-subsystem. 
There are two questions associated with each bursting pattern: 


e What initecates sustained spiking during the burst? 
e What terminates sustained spiking (temporarily) and ends the burst? 


The answer to the first question is relatively simple. Repetitive spiking is initiated and 
sustained by the positive injected current J or some other source of persistent inward 
current that causes the neuron to fire (most biologists are interested in identifying this 
source, and they would not consider this question trivial). Surprisingly, the second 
question is the more important for building a model of bursting. While the neuron 
fires, relatively slow processes somehow make it non-excitable and eventually terminate 
the firing. Such slow processes result in a slow buildup of an outward current or in a 
slow decrease of an inward current needed to sustain the spiking. During the quiescent 
phase, the neuron slowly recovers and regains the ability to generate action potentials. 

Let us discuss possible ionic mechanisms responsible for the termination of spiking 
within a burst. Suppose we are given a neuronal model that is capable of sustained 
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Figure 9.6: Four major classes of bursting models are defined by the slow resonant 


gating variables that modulate spiking activity. 


spiking activity, at least when a positive J is injected. To transform an infinite spike 
train into a finite burst of spikes, it suffices to add a slow resonant current or gating 
variable (see section 5.1.1) that modulates the spiking via a slow negative feedback. The 
resonant gating variable can describe inactivation of an inward current or activation 
of an outward current, either voltage- or Ca?+-dependent (see Fig.5.17). Hence, there 
are four major classes of bursting models, summarized in Fig.9.6: 


e Voltage-gated inactivation of an inward current, e.g., slow inactivation of a per- 


sistent Nat current or inactivation of a Ca?* transient T-current, or inactivation 
of the h-current (most biologists refer to this as activation of the h-current by 
hyperpolarization). Repetitive spiking slowly inactivates (turns off) the inward 
current, and makes the neuron less excitable and unable to sustain spiking ac- 
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tivity. After a while, the spiking stops and the membrane potential repolarizes. 
The inward current slowly de-inactivates (turns on) and depolarizes the mem- 
brane potential, possibly resulting in a new burst. 


e Voltage-gated activation of an outward current, e.g., slow activation of a persis- 
tent K* current, such as the M-current. Repetitive spiking slowly activates the 
outward current, which eventually terminates the spiking activity. While at rest, 
the outward current slowly deactivates (turns off) and unmasks inward currents 
that can depolarize the membrane potential, possibly initiating another burst. 


e Ca**-gated inactivation of an inward current, e.g., slow inactivation of high- 
threshold Ca?+-currents Icact) or Icacn). Entry of calcium during repetitive spik- 
ing leads to its intracellular accumulation and slow inactivation of Ca?*-channels 
that provide an inward current needed for repetitive spiking. As a result, the 
neuron cannot sustain spiking activity, and becomes quiescent. During this pe- 
riod, intracellular Ca?+ ions are removed, Ca?+ channels are de-inactivated, and 
the neuron is primed to start a new burst. 


e Ca?*-gated activation of an outward current, e.g., slow activation of the Ca?*- 
dependent K*-current I,yp. Calcium entry and buildup during repetitive spiking 
slowly activate the outward current and make the neuron less and less excitable. 
When the spiking stops, intracellular Ca?* ions are removed, the Ca?+-gated out- 
ward current deactivates (turns off), and the neuron is no longer hyperpolarized 
and is ready to fire a new burst of spikes. 


In addition, the slow process may include Na*-, K*-, or Cl--gated currents, such as the 
“slack and slick” family of Na*-gated Kt currents, or slow change of ionic concentra- 
tions in the vicinity of the cell membrane (the Hodgkin-Frankenhaeuser layer), which 
leads to slow change of the Nernst potential for ionic species. We do not elaborate 
these cases in this book. 


Note that in some cases, the slow process modulates fast currents responsible for 
spiking, while in other cases it produces an independent slow current that impedes 
spiking. In any case, the slow process is directly responsible for the termination of 
continuous spiking, and indirectly responsible for its initiation and maintenance. 


The four mechanisms in Fig.9.6 and their combinations are ubiquitous in neurons, 
aS we summarize in Fig.9.7. However, there could be other, less obvious bursting 
mechanisms. In exercises 8-10 we provide examples of bursters having slowly activating 
persistent inward current, such as Iya». These surprising examples show that buildup 
of the inward current (or any other amplifying gate) can also be responsible for the 
termination of the active phase and for the repolarization of the membrane potential. 
To understand these mechanisms, one needs to study the geometry of bursting. 
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Figure 9.7: Slow dynamics in bursting neurons. 


9.1.3. Minimal Models 


Let us follow the ideas presented in section 5.1 and determine minimal models for 
bursting. That is, we are interested in classification of all fast-slow electrophysiological 
models that can exhibit sustained bursting activity, as in Fig.9.4b, at least for some 
values of parameters. A bursting model is minimal if removal of any current or gating 
variable eliminates the ability to burst. 

One way to build a fast-slow minimal model for bursting is to take a minimal model 
for spiking, which consists of an amplifying gate and a resonant gate (see Fig.5.17) 
and add another slow resonant gate. Since there are many minimal spiking models 
in Fig.5.17 and four choices of slow resonant gates in Fig.9.6, there are quite a few 
combinations, which fill the squares in Fig.9.8. We present only a few reasonable 
models in the figure; the reader is asked to fill in the blanks. Completing the table 
is an excellent test of one’s knowledge and understanding of how different currents 
interact to produce nontrivial firing patterns. 
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Figure 9.8: Some minimal models for bursting. 


Some of the minimal models for bursting might seem too bizarre at first glance. 
Yet Fig.9.8, upon completion, might prove to be a valuable tool that could allow 
experimenters to formulate various ionic hypotheses. For example, if one uses pharma- 
cological agents (e.g., TEA or Ba?*) to block Ca?*-gated K* channels and shows that 
bursting persists, then the possible electrophysiological mechanisms of bursting are 
confined to the left column in Fig.9.8. Minimal models in this column would provide 
testable hypotheses for the ionic basis of bursting, and they could guide novel exper- 
iments. If a block abolishes bursting, we cannot conclude that the blocked current 
drives the bursting — it may merely be necessary for providing background stimulation. 

Note that the Inat,,,, + Jk-model and the Iyat + Jkqqy-model in the figure (see 
the shaded rectangles) consist of the same gating variables: Na* activation gate m, 
inactivation gate h, and K* activation gate n. Both models are equivalent to the 
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Figure 9.9: Hodgkin-Huxley (1952) model with three gating variables is minimal for 
bursting. (Modified from Fig. 1.10 in Izhikevich 2001b.) 


Hodgkin-Huxley model, the only difference being the choice of the slow gate. Thus, in 
contrast to the common biophysical folklore, the Hodgkin-Huxley model is a minimal 
model for bursting, and there are two fundamentally different ways in which one can 
make it burst without any additional currents, as we show in Fig.9.9. Of course, one 
may argue that the model in the figure is not Hodgkin-Huxley at all, since we changed 
the kinetics of some currents by an order of magnitude. 

Thinking in terms of minimal models, we can understand what is essential for 
spiking and bursting and what is not. In addition, we can clearly see that some well- 
known conductance-based models form a partially ordered set. For example, the chain 
of neuronal models Morris-Lecar (IcatIx) < Hodgkin-Hualey INat+Ix) < Butera- 
Rinzel-Smith (Inat+Ik+l slow) is obtained by adding a conductance or gating variable 
to one model to get the next one. Here, A ~ B means A is a subsystem of B. 

Understanding the ionic bases of bursting is an important step in analysis of burst- 
ing dynamics. However, such an understanding may not provide sufficient information 
on why the bursting pattern looks as it does, what the neurocomputational properties 
of the neuron are, and how they depend on the parameters of the system. Indeed, we 
showed in chapter 5 that spiking models based on quite different ionic mechanisms can 
have identical dynamics and vice versa. This is true for bursting models as well. 


9.1.4 Central Pattern Generators and Half-Center Oscillators 


Bursting can also appear in small circuits of coupled spiking neurons, such as the two 
mutually inhibitory oscillators in Fig.9.10, called half-center oscillators. While one cell 
fires, the other is inhibited; then they switch roles; and so on. Such small circuits, 
suggested by Brown (1911), are the building blocks of central pattern generators in the 
pyloric network of the lobster stomatogastric ganglion, the medicinal leech heartbeat, 
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Figure 9.10: Central pattern generation by mutually inhibitory oscillators. 


fictive motor patterns, and the swimming patterns of many vertebrates and inverte- 
brates (Marder and Bucher 2001). We show later that this bursting is of cycle-cycle 
type. 

What makes the oscillators in Fig.9.10 alternate? Wang and Rinzel (1992) suggested 
two mechanisms, release and escape, which were later refined to intrinsic and synaptic 
by Skinner et al. (1994): 


e Intrinsic release: The active cell stops spiking, terminates inhibition, and allows 
the inhibited cell to fire. 


e Intrinsic escape: The inhibited cell recovers, starts to fire, and shuts off the active 
cell. 


e Synaptic release: The inhibition weakens (e.g., due to spike frequency adaptation 
or short-term synaptic depression) and allows the inhibited cell to fire. 


e Synaptic escape: The inhibited cell depolarizes above a certain threshold and 
starts to inhibit the active cell. 


All four mechanisms assume that in addition to fast variables responsible for spiking, 
there are slow adaptation variables responsible for slowing or termination of spiking, 
recovery, or synaptic depression. Thus, similar to the minimal models above, the circuit 
has at least two time scales, that is, it is a fast-slow system. 


9.2 Geometry 


To understand the neurocomputational properties of bursters, we need to study the 
geometry of their phase portraits. In general, it is quite a difficult task. However, it 
can be accomplished in the special case of fast-slow dynamics. 
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Figure 9.11: Parameter u can control spik- 
ing behavior of the fast subsystem in (9.1). 
When wu changes slowly, the model exhibits 
bursting behavior. 


9.2.1 Fast-Slow Bursters 


We say that a neuron is a fast-slow burster if its behavior can be described by a 
fast-slow system of the form 


= Fo) (fast spiking), 


= poe.@) (slow modulation). (9-1) 


x 
u 


The vector x € R™ describes fast variables responsible for spiking. It includes the 
membrane potential V, activation and inactivation gating variables for fast currents, 
and so on. The vector u € R* describes relatively slow variables that modulate fast 
spiking (e.g., gating variable of a slow K* current, an intracellular concentration of 
Ca?" ions, etc.). The small parameter yz represents the ratio of time scales between 
spiking and modulation. When we analyze models, we assume that 4 < 1; that is, it 
can be as small as we wish. The results obtained via such an analysis may not have 
any sense when yp is of the order 0.1 or greater. 

To analyze bursters, we first assume that = 0, so that we can consider the fast 
and slow systems separately. This constitutes the method of dissection of neural 
bursting pioneered by Rinzel (1985). In fact, we have done this many times in the 
previous chapters when we substituted m = m(V) into the voltage equation. The 
fast subsystem can be resting (but excitable), bistable, or spiking, depending on the 
value of u; see Fig.9.11. Bursting occurs when u visits the spiking and quiescent areas 
periodically. Many important aspects of bursting behavior can be understood via phase 
portrait analysis of the fast subsystem 


P= Tea), xz € R”, 


treating u € R* as a vector of slowly changing bifurcation parameters. 

We say that the burster is of the “m+k” type when the fast subsystem is m- 
dimensional and the slow subsystem is k-dimensional. There are some “1+1” and 
“2-+0” bursters (see exercises 1-4), though they do not correspond to any known neu- 
ron. Most of the bursting models in this chapter are of the “2+1” or “2+2” type. 


9.2.2 Phase Portraits 


Since most bursting models are at least of the “2+1” type, their phase space is at 
least three-dimensional. Analyzing and depicting multidimensional phase portraits 
is challenging. Even understanding the geometry of the single bursting trajectory 
depicted in Fig.9.12 is difficult unless one uses a stereoscope. 
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Figure 9.12: Stereoscopic image of a bursting trajectory of the Ina pt+Jk+Jkay-model 
in the three-dimensional phase space (V,7, Nsiow) (for cross-eye viewing). 


In Fig.9.13 we geometrically investigate the Ina pt+Jk+Jky-model, which is a fast- 
slow burster of the “2+1” type. The naked bursting trajectory is shown in the lower 
left corner. We set fz = 0 (i-€., Tslow(V) = +00) and slice the three-dimensional space 
by planes nsjow =const, shown in the top right corner. Phase portraits of the two- 
dimensional fast subsystem with fixed ngow are shown in the middle of the figure. Note 
how the limit cycle attractors and the equilibria of the fast subsystem depend on the 
value of Now. Gluing the phase portraits together, we see that there is a manifold of 
limit cycle attractors (shaded cylinder) that starts when ngjow < 0 and ends in a saddle 
homoclinic orbit bifurcation when ngjoy = 0.066. There is also a locus of stable and 
unstable equilibria that appears via a saddle-node bifurcation when ngjow = 0.0033. 

Once we understand the transitions from one phase portrait to another as the slow 
variable changes, we can understand the geometry of the burster. Suppose pu > 0 (ie., 
Tslow(V) = 20 ms), so that nsiow can evolve according to its gating equation. 

Let us start with the membrane potential at the stable equilibrium corresponding 
to the resting state. The parameters of the INapt+J«K+Jkimy-model (see caption of 
Fig.9.4) are such that the slow Kt M-current deactivates at rest, that is, Ngow slowly 
decreases, and the bursting trajectory slides along the bold half-parabola corresponding 
to the locus of stable equilibria. After a while, the Kt current becomes so small that 
it cannot hold the membrane potential at rest. This happens when ngjow passes the 
value 0.0033, the stable equilibrium coalesces with an unstable equilibrium (saddle), 
and they annihilate each other via saddle-node bifurcation. Since the resting state no 
longer exists (see the phase portrait at the top left of Fig.9.13), the trajectory jumps up 
to the stable limit cycle corresponding to repetitive spiking. This jumping corresponds 
to the transition from resting to spiking behavior. 
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Figure 9.13: Bursting trajectory of the [njap+JK+Jkcm)-model in three-dimensional 
phase space and its slices ngjoy = const. 
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While the fast subsystem fires spikes, the Kt M-current slowly activates, that is, 
Nslow Slowly increases. The bursting trajectory winds up around the cylinder corre- 
sponding to the manifold of limit cycles. Each rotation corresponds to firing a spike. 
After the ninth spike in the figure, the K* current becomes so large that repetitive 
spiking cannot be sustained. This happens when ngjoy passes the value 0.066, the limit 
cycle becomes a homoclinic orbit to a saddle, and then disappears. The bursting tra- 
jectory jumps down to the stable equilibrium corresponding to the resting state. This 
jumping corresponds to the termination of the active phase of bursting and transition 
to resting. While at rest, the KT current deactivates, nsjoy decreases, and so on. 

Figure 9.13 presents the inner structure of the geometrical mechanism of bursting 
of the InaptJk+Jk(my-model with parameters as in Fig.9.4. Other values of the pa- 
rameters can result in different geometrical mechanisms, summarized in section 9.3. In 
all cases, our approach is the same: freeze the slow subsystem by setting w = 0; ana- 
lyze phase portraits of the fast subsystem, treating the slow variable as a bifurcation 
parameter; glue the phase portraits; let «4 #4 0 but small; and see how the evolution 
of the slow subsystem switches the fast subsystem between spiking and resting states. 
The method usually breaks down if jz is not small enough, because evolution of the 
“slow” variable starts to interfere with that of the fast variable. How small is small 
depends on the particulars of the equations describing bursting activity. One should 
worry when sz is greater than 0.1. 


9.2.3 Averaging 


What governs the evolution of the slow variable u? To study this question, we describe 
a well-known and widely used method that reduces the fast-slow system (9.1) to its 
slow component. In fact, we have already used this method in chapters 3 and 4 to 
reduce the dimension of neuronal models via the substitution m = m(V). Using 
essentially the same ideas, we take advantage of the two time scales in (9.1) and get 
rid of the fast subsystem by means of the substitution x = x(w). 

When the neuron is resting, its membrane potential is at an equilibrium and all 
fast gating variables are at their steady-state values, so that x = Zrest(u). Using this 
function in the slow equation in (9.1), we obtain 


hg (Epa (4) 4) (reduced slow subsystem), (9.2) 


which easily can be studied using the geometrical methods presented in Chapters 3 
and 4. 

Let us illustrate all the steps involved using the Ina pyt+lk+Jk«wpj-model, with ngiow 
being the gating variable of the slow Kt M-current. First, we freeze the slow subsystem, 
that is, set Tslow(V) = 00 so that pp = 1/Tg1ow = 0, and numerically determine the resting 
potential V,.., as a function of the slow variable ngjow. The function V = Vyest(Mstow) 
is depicted in Fig.9.14 (top) and it coincides with the solid half-parabola in Fig.9.13. 
Then, we use this function in the gating equation for the M-current to obtain (9.2) 


Talow = (esdiow (Vrest (Hgiows) ) = Tislow) I Teles Qiao (nestow) ) = g (Nslow ) ; 
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depicted in Fig.9.14 (bottom). Note that g < 0, meaning that ngiow decreases while 
the fast subsystem rests. The rate of decrease is fairly small when ngjow ¥ 0. 

A similar method of reduction, with an extra step, can be used when the fast 
subsystem fires spikes. Let x(t) = Xspike(t, uw) be a periodic function corresponding to 
an infinite spike train of the fast subsystem when w is frozen. Slices of this function are 
shown in Fig.9.14 (top). Let T(w) be the period of spiking oscillation. The periodically 
forced slow subsystem 


tb = pO Paice t,), 0) (slow subsystem) (9.3) 


can be averaged and reduced to a simpler model, 


w = pg(w) (averaged slow subsystem), (9.4) 


by a near-identity change of variables w = u+ o(), where o(j1) denotes small terms of 
order p or less. Here, 


1 


T(w) 
aw) = = ; a (apive(t, w), w) at 


is the average of g, shown in Fig.9.14 (bottom), for the Iyap+Jk+Jkcmy-model. (The 
reader should check that g(w) = g(2rest(w),w) when the fast subsystem is resting.) 
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Limit cycles of the averaged slow subsystem correspond to bursting dynamics, whereas 
equilibria correspond to either resting or periodic spiking states of the full system (9.1) 
— the result is known as the Pontryagin-Rodygin (1960) theorem. Interesting regimes 
correspond to the coexistence of limit cycles and equilibria of the slow averaged system. 

The main purpose of averaging consists in replacing the wiggle trajectory of u(t) 
with a smooth trajectory of w(t), as we illustrate in Fig.9.15. We purposely used 
a different letter, w, for the new slow variable to stress that (9.4) is not equivalent 
to (9.3). Their solutions are o(j1)-close to each other only when certain conditions are 
satisfied; see Guckenheimer and Holmes (1983) or Hoppensteadt and Izhikevich (1997). 
In particular, this straightforward averaging breaks down when wu slowly passes the 
bifurcation values. For example, the period, T(u), of Xspixe(t, w) may go to infinity, as 
happens near saddle-node on invariant circle and saddle homoclinic orbit bifurcations, 
or transients may take as long as 1/, or the averaged system (9.4) is not smooth. All 
these cases are encountered in bursting models. Thus, one can use the reduced slow 
subsystem only when the fast subsystem is sufficiently far from a bifurcation, that is, 
away from the shaded regions in Fig.9.14. 


9.2.4 Equivalent Voltage 


Let us consider a “2+1” burster with a slow subsystem depending only on the slow vari- 
able and the membrane potential V, as in the Iyapt+JK+JKcqy-model. The nonlinear 
equation 

g(V,u) = g(u) (9.5) 
can be solved for V. The solution, V = Viguiv(u), is referred to as the equivalent 
voltage (Kepler et al. 1992; Bertram et al. 1995) because it replaces the periodic 
function 2spike(t, u) in (9.3) with an “equivalent” value of the membrane potential, so 
that the reduced slow subsystem (9.3) has the same form, 


4b = p19 Vequiy (Ut), 1) (slow subsystem), (9.6) 


as in (9.1). (The reader should check that Veguiv(w) = Viest(u) when the fast subsystem 
is resting.) An interesting mathematical possibility occurs when Voguiy during spiking 
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Figure 9.16: Projection of bursting trajectory of the Iya p»+JK+JK(my-model onto the 
(Nslow, V) plane. 


is below Vyest, leading to bizarre bursters having amplifying slow currents, such as the 
one in exercise 10. 

We depict the equivalent voltage of the INap+Jk+J«(my-model in Fig. 9.16 (left) 
(variable u corresponds to ngjow)- In the same figure we depict the steady-state acti- 
vation function n = Neoslow(V) (notice the flipped coordinate system). We interpret 
the two curves as fast and slow nullclines of the reduced (V, nsiow) system. During the 
active (spiking) phase of bursting, the reduced system slides along the upper branch 
of Viguiv(Msiow) to the right. When it reaches the end of the branch, it falls downward 
to the lower branch corresponding to resting, and slides along this branch to the left. 
When it reaches the left end of the lower branch, it jumps to the upper branch, and 
thereby closes the hysteresis loop. Figure 9.16 (right) summarizes all the information 
needed to understand the transitions between resting and spiking states in this model. 
It depicts the bursting trajectory, loci of equilibria of the fast subsystem, and the volt- 
age range of the spiking limit cycle as a function of the slow gate ngow. With some 
experience, one can read this complicated figure and visualize the three-dimensional 
geometry underlying bursting dynamics. 


9.2.5 Hysteresis Loops and Slow Waves 


Sustained bursting activity of the fast-slow system (9.1) corresponds to periodic (or 
chaotic) activity of the reduced slow subsystem (9.6). Depending on the dimension of 
u, that is, on the number of slow variables, there could be two fundamentally different 
ways the slow subsystem oscillates. 

If the slow variable u is one-dimensional, then there must be a bistability of resting 
and spiking states of the fast subsystem so that wu oscillates via a hysteresis loop. That 
is, the reduced equation (9.6) consists of two parts: one for Veguiy(u), corresponding 
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Figure 9.17: Hysteresis loop periodic bursting. 
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Figure 9.18: Burst excitability: a perturbation causes a burst of spikes. 


to spiking, and one for Viguiv(u), corresponding to resting of the fast subsystem, as in 
Fig.9.16 (left). Such a hysteresis loop bursting can also occur when wu is multidimen- 
sional, as we illustrate in Fig.9.17. The vector field on the top (spiking) leaf pushes u 
outside the spiking area, whereas the vector field on the bottom (resting) leaf pushes u 
outside the resting area. As a result, u visits the spiking and resting areas periodically, 
and the model exhibits hysteresis loop bursting. 

If resting x does not push u into the spiking area, but leaves it in the bistable area, 
then the neuron exhibits burst excitability. It has quiescent excitable dynamics, but 
its response to perturbations is not a single spike, rather, it is a burst of spikes, as 
we illustrate in Fig.9.18. Grade III bursters of the hippocampus (Fig.8.34Eb) produce 
such a response, often called a complex spike response, to brief stimuli. In general, 
many bistable models are bistable only because they neglect slow currents and other 
homeostatic processes present in real neurons. If the currents are taken into account, 
then the models become bistable on a short time scale and burst excitable on a longer 
time scale. This justifies why many researchers refer to bistable systems as excitable, 
implicitly assuming that the response to superthreshold perturbations is either a single 
spike or a long train of spikes. 

If the fast subsystem does not have a coexistence of resting and spiking states, then 
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Figure 9.19: Bifurcations of bursting solutions in the INay+/kK+Jk(mj-model as the 
magnitude of the injected DC current J changes. 


the reduced slow subsystem (9.6) must be at least two-dimensional to exhibit sustained 
autonomous oscillation (however, see exercise 6). Such an oscillation produces a depo- 
larization wave that drives the fast subsystem to spiking and back, as in Fig.9.3. We 
refer to such bursters as slow-wave bursters. Quite often, however, the slow subsystem 
of a slow-wave burster needs the feedback from the fast subsystem to oscillate. For 
example, in section 9.3.2 we consider slow-wave bursting in the Iyap»t+l«K+JnNastow + 
Tixavy-model, whose slow subsystem consists of two uncoupled equations, and hence 
cannot oscillate by itself unless the fast subsystem is present. 


9.2.6 Bifurcations “Resting ~ Bursting © Tonic Spiking” 


Switching between spiking and resting states during bursting occurs because the slow 
variable drives the fast subsystem through bifurcations of equilibria and limit cycle 
attractors. These bifurcations play an important role in the classification of bursters 
and in understanding their neurocomputational properties. We discuss them in detail 
in section 9.3. 

Since the fast subsystem goes through bifurcations, does this mean that the entire 
system (9.1) undergoes bifurcations during bursting? The answer is NO. As long as 
parameters of (9.1) are fixed, the system as a whole does not undergo any bifurcations, 
no matter how small yz is. The system can exhibit periodic, quasi-periodic, or even 
chaotic bursting activity, but its (m+ k)-dimensional phase portrait does not change. 
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The only way to make system (9.1) undergo a bifurcation is to change its param- 
eters. For example, in Fig.9.19 we change the magnitude of the injected DC current 
I in the Ivap+Jk+Jkywy-model. Apparently, no bursting exists when J = 0. Then, 
repetitive bursting appears with a large interburst period that decreases as I increases. 
The value J = 5 was used to obtain bursting solutions in Fig.9.12 and Fig.9.13. In- 
creasing J further increases the duration of each burst, until it becomes infinite, that 
is, bursting turns into tonic spiking. When J > 8, the slow Kt current is not enough 
to stop spiking. 


In Fig.9.20 we depict the geometry of bursting in the INay+JK+JK(my-model when 
I = 3 (just before periodic bursting appears) and when J = 10 (just after bursting 
turns into tonic spiking). 


When J = 3, the nullcline of the slow subsystem nglow = Noo,slow(V) intersects the 
locus of stable equilibria of the fast subsystem. The intersection point is a globally 
stable equilibrium of the full system (9.1). Small perturbations, whether in the V 
direction, the n direction, or the ngjow direction, subside, whereas a large perturbation 
(e.g., in the V direction) that moves the membrane potential to the open square in the 
figure initiates a transient (phasic) burst of seven spikes. Increasing the magnitude of 
the injected current J shifts the saddle-node parabola to the right. When J & 4.54, 
the nullcline of the slow subsystem does not intersect the locus of stable equilibria, and 
the resting state no longer exists, as in Fig.9.16 (right). There is still a global steady 
state, but it is not stable. 


Further increase of the magnitude of the injected current J results in the inter- 
section of the nullcline of the slow subsystem with the equivalent voltage function 
Vequiv(Msiow)- The intersection, marked by the black circle in Fig.9.20 (right), corre- 
sponds to a globally stable (spiking) limit cycle of the full system (9.1). A sufficiently 
strong perturbation can push the state of the fast subsystem into the attraction do- 
main of the stable (resting) equilibrium. While the fast subsystem is resting, the slow 
variable decreases (i.e., the K* current deactivates), the resting equilibrium disappears, 
and repetitive spiking resumes. 


Figures 9.19 and 9.20 illustrate possible transitions between bursting and resting, 
and bursting and tonic spiking. There could be other routes of emergence of bursting 
solutions from resting or spiking; some of them are in Fig.9.21. Each such route corre- 
sponds to a bifurcation in the full system (9.1) with some y > 0. For example, the case 
a — 0 corresponds to supercritical Andronov-Hopf bifurcation; the case c + oo corre- 
sponds to a saddle-node on invariant circle or saddle homoclinic orbit bifurcation; the 
case d — oo corresponds to a periodic orbit with a homoclinic structure, e.g., blue-sky 
catastrophe, fold limit cycle on homoclinic torus bifurcation, or something more com- 
plicated. The transitions bursting + spiking often exhibit chaotic (irregular) activity, 
so Fig.9.21 is probably a great oversimplification. Understanding and classifying all 
possible bifurcations leading to bursting dynamics is an important but open problem; 
see exercise 27. 
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Figure 9.20: Burst excitability (J = 3, left) and periodic spiking (J = 10, right) in the 


Ixap+Ik+Ik(my-model. 
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Figure 9.21: Possible transitions between repetitive bursting and resting, and repetitive 
bursting and repetitive spiking. 


9.3 Classification 


In Fig.9.22 we identify two important bifurcations of the fast subsystem that are asso- 
ciated with bursting activity in the fast-slow burster (9.1): 


e (resting > spiking). Bifurcation of an equilibrium attractor that results in tran- 
sition from resting to repetitive spiking. 


e (spiking > resting). Bifurcation of the limit cycle attractor that results in tran- 
sition from spiking to resting. 


The ionic basis of bursting, that is, the fine electrophysiological details, determines the 
kinds of bifurcations in Fig.9.22. The bifurcations, in turn, determine the neurocom- 
putational properties of fast-slow bursters, discussed in section 9.4. 


spiking state 
(limit cycle) 


bifurcation of limit cycle 
(transition to resting) 


bifurcation of equilibrium 
(transition to spiking) 


resting state (equilibrium) resting state (equilibrium) 


Figure 9.22: Two important bifurcations associated with fast-slow bursting. 
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Figure 9.23: Classification of planar point-cycle fast-slow bursters based on the 
codimension-1 bifurcations of the resting and spiking states of the fast subsystem. 


A complete topological classification of bursters based on these two bifurcations is 
provided by Izhikevich (2000a), who identified 120 different topological types. Here, 
we consider only 16 planar point-cycle codimension-1 fast-slow bursters. We say that a 
fast-slow burster is planar when its fast subsystem is two-dimensional. We emphasize 
planar bursters because they have a greater chance of being encountered in computer 
simulations (but not necessarily in nature). We say that a burster is of the point- 
cycle type when its resting state is a stable equilibrium point and its spiking state is a 
stable limit cycle. All bursters considered so far, including those in Fig.9.1, are of the 
point-cycle type. Other, less common types, such as cycle-cycle and point-point, are 
considered as exercises. 

We consider here only bifurcations of codimension 1, that is, those that need only 
one parameter and hence are more likely to be encountered in nature. Having a two- 
dimensional fast subsystem imposes severe restrictions on possible codimension-1 bifur- 
cations of the resting and spiking states. In particular, there are only four bifurcations 
of equilibria and four bifurcations of limit cycles, which we considered in chapter 6 
and summarized in figures 6.46 and 6.47. Any combination of them results in a dis- 
tinct topological type of fast-slow bursting; hence there are 4 x 4 = 16 such bursters, 
summarized in Fig.9.23. 

We name the bursters according to the types of the bifurcations of the resting 
and spiking states. To keep the names short, we refer to saddle-node on invariant 
circle bifurcation as a “circle” bifurcation because it is the only codimension-1 bifur- 
cation on a circle manifold S'. We refer to supercritical Andronov-Hopf bifurcation 
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Figure 9.24: Examples of “2+1” point-cycle fast-slow codimension-1 bursters of 
hysteresis-loop type (modified from Izhikevich 2000a). Dashed chains of arrows show 
transitions that might involve bifurcations not relevant to the bursting type. 
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Figure 9.25: “Fold/homoclinic” bursting. The resting state disappears via saddle-node 
(fold) bifurcation, and the spiking limit cycle disappears via saddle homoclinic orbit 
bifurcation. 
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as just the “Hopf” bifurcation, the subcritical Andronov-Hopf as the “subHopf”, the 
fold limit cycle bifurcation as the “fold cycle”, and the saddle homoclinic orbit bifur- 
cation as the “homoclinic” bifurcation. Thus, the bursting pattern exhibited by the 
INap+1k+J(mpy-model in Fig.9.13 is of the “fold/homoclinic” type because the resting 
state penne es via “fold” bifurcation, and the spiking limit cycle attractor disappears 
via saddle “homoclinic” orbit bifurcation. 

In a way similar to Fig.9.13, we depict the geometry of the other bursters in Fig.9.24. 
This figure gives only examples, and does not exhaust all possibilities. Let us consider 
some of the most common bursting types in detail. 


9.3.1 Fold/Homoclinic 


When the resting state disappears via a saddle-node (fold) bifurcation and the spiking 
limit cycle disappears via a saddle homoclinic orbit bifurcation, the burster is said to 
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Figure 9.26: Putative “fold/homoclinic” bursting in a pancreatic (6-cell. (Modified 
from Kinard et al. 1999.) 
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Figure 9.27: Putative ”fold/homoclinic” bursting in a cell located in the pre-Botzinger 
complex of rat brain stem. (Data shared by Christopher A. Del Negro and Jack L. 
Feldman, Systems Neurobiology Laboratory, Department of Neurobiology, UCLA.) 


be of the “fold/homoclinic” type depicted in Fig.9.25. Note the bistability of resting 
and spiking states, resulting in the hysteresis loop oscillation of the slow subsystem. 
“Fold/homoclinic” bursting is quite common in neuronal models, such as in the 
INapt+Ikt+Ik(mj-model considered in this chapter; see Fig.9.13. It was first character- 
ized in the context of the insulin-producing pancreatic $-cells in Fig.9.26, with intra- 
cellular concentration of Ca?* ions being the slow resonant variable (Chay and Keizer 
1983). Neurons located in the pre-Botzinger complex, a region that is associated with 
generating the rhythm for breathing, also exhibit this kind of bursting (Butera et al. 
1999), as shown in Fig.9.27. Intrinsic bursting (IB) and chattering (CH) behavior of 
the simple model in section 8.2 could be of the “fold/homoclinic” type too, provided 
the parameter a is sufficiently small. Because of the distinct square-wave shape of 
oscillations of the membrane potential in figures 9.26 and Fig.9.27, this bursting was 
called “square-wave” bursting in earlier studies. Since many types of bursters resemble 
square waves, referring to a burster by its shape is misleading and should be avoided. 
In Fig.9.25 (bottom) we depict a typical configuration of nullclines of the fast sub- 
system during “fold/homoclinic” bursting. The resting state of the membrane potential 
corresponds to the left stable equilibrium, which is the intersection of the left knee of 
the fast N-shaped nullcline with the slow nullcline. During resting, the N-shape null- 
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Figure 9.28: A neural system near codimension-2 saddle-node homoclinic orbit bifur- 
cation (center dot) can exhibit four different types of fast-slow bursting, depending on 
the trajectory of the slow variable u € R? in the two-dimensional parameter space. 
Solid (dotted) lines correspond to spiking (resting) regimes. 


cline slowly moves upward, until its knee touches the slow nullcline at a saddle-node 
point. Right after this moment, the resting state disappears via saddle-node (fold) 
bifurcation; hence the “fold” in the name of the burster. After the fold bifurcation, 
the membrane potential jumps up to the stable limit cycle corresponding to repetitive 
spiking. During the spiking state, the N-shaped nullcline slowly moves downward, and 
the middle (saddle) equilibrium moves away from the resting state toward the limit 
cycle. After a while, the limit cycle becomes a homoclinic trajectory to the saddle, 
and then the cycle disappears via saddle homoclinic orbit bifurcation; hence the “ho- 
moclinic” in the name of the burster. After this bifurcation, the membrane potential 
jumps down to the resting state and closes the hysteresis loop. 


Suppose that the hysteresis loop oscillation of the slow variable u has a small ampli- 
tude. That is, the saddle-node bifurcation and the saddle homoclinic orbit bifurcation 
occur for nearby values of the parameter wu. In this case, the fast subsystem of (9.1) is 
near codimension-2 saddle-node homoclinic orbit bifurcation, depicted in Fig.9.28 and 
studied in section 6.3.6. The figure shows a two-parameter unfolding of the bifurcation, 
treating u € R? as the parameter. A stable equilibrium (resting state) exists in the left 
half-plane, and a stable limit cycle (spiking state) exists in the right half-plane of the 
figure and in the shaded (bistable) region. “Fold/homoclinic” bursting occurs when 
the bifurcation parameter, being a slow variable, oscillates between the resting and 
spiking states through the shaded region. Due to the bistability, the parameter could 
be one-dimensional. Other trajectories of the slow parameter correspond to other types 
of bursting. 
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Figure 9.29: “Fold/homoclinic” bursting in the canonical model (9.7) with parameters 
u = 0.02, 1 =1, and d=0.2. 


In exercise 16 we prove that there is a piecewise continuous change of variables that 
transforms any “fold/homoclinic” burster with a fast subsystem near such a bifurcation 
into the canonical model (see section 8.1.5) 

A _ IT o 
i nee (9.7) 
= —MU, 


with an after-spike resetting 


ifv=-+oo, then v¢1 and ut udtd. 


Here v € R is the re-scaled membrane potential of the neuron; u € R is the re-scaled 
net outward (resonant) current that provides a negative feedback to v; and J,d, and 
ju < 1 are parameters. This model is related to the canonical model considered in 
section 8.1.4, and it is simplified further in exercise 15. 

The fast subsystem @ = (I — u) + v? is the normal form for the saddle-node bifur- 
cation, and with the resetting it is known as the quadratic integrate-and-fire neuron 
(section 3.3.8). When u > I, there is a stable equilibrium v,.4. = —Vu— TJ corre- 
sponding to the resting state. While the parameter u slowly decreases toward u = 0, 
the stable equilibrium and the saddle equilibrium Vjhresh = +Wu—J approach and 
annihilate each other at u = I via saddle-node (fold) bifurcation. When u < I, the 
membrane potential v increases and escapes to infinity in a finite time, that is, it fires 
a spike. (Instead of infinity, any large value can be used in simulations.) The spike 
activates fast outward currents and resets v to 1, as in Fig.9.29. It also activates slow 
currents and increments wu by d. If the reset value 1 is greater than the threshold po- 
tential Vihresh, the fast subsystem fires another spike, and so on, even when u > J; see 


304 Bursting 


saddle-node on = 
invariant circle bitdieation ‘y 
woe 


saddle-node on invariant 
circle bifurcation 


saddle-node saddle-node 
on invariant on invariant 
circle bifurcation circle bifurcation 
\/ 


Figure 9.30: “Circle/circle” bursting. The resting state disappears via saddle-node on 
invariant circle bifurcation, and so does the spiking limit cycle. 


Fig.9.29. Since each spike increases u, the repetitive spiking stops when u = J + 1 via 
saddle homoclinic orbit bifurcation. The membrane potential jumps downward to the 
resting state, the hysteresis loop is closed, and the variable u decreases (recovers) to 
initiate another “fold/homoclinic” burst. One can vary J in the canonical model (9.7) 
to study transitions from quiescence to bursting to tonic spiking, as in Fig.9.20. 


9.3.2 Circle/Circle 


When the equilibrium corresponding to the resting state disappears via a saddle-node 
on invariant circle bifurcation, and the limit cycle attractor corresponding to the spik- 
ing state disappears via another saddle-node on invariant circle bifurcation, the burster 
is said to be of the “circle/circle” type shown in Fig.9.30. Since the bifurcation does not 
produce a coexistence of attractors, there is usually no hysteresis loop, and the burst- 
ing is of the slow-wave type with at least two slow variables. (An unusual example 
of “circle/circle” hysteresis loop bursting in a “2+1” system is provided by Izhikevich 
(2000a)). 

“Circle/circle” bursting is a prominent feature of the R15 cells in the abdominal gan- 
glion of the mollusk Aplysia, shown in Fig.9.31 (Plant 1981). It was called “parabolic” 
bursting in earlier studies because the interspike period depicted in Fig.9.32 was er- 
roneously thought to be a parabola. In section 6.1.2 we showed that when a system 
undergoes a saddle-node on invariant circle bifurcation, its period scales as 1/ Vd, 
where 4 is the distance to the bifurcation. Two pieces of this function, put together 
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Figure 9.31: Putative “circle/circle” bursting pacemaker activity of neuron Rj; in the 
abdominal ganglion of the mollusk Aplysia. (Modified from Levitan and Levitan 1988.) 
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Figure 9.32: The interspike period in the “circle/circle” bursting in Fig.9.31 resembles 
a parabola, which led to the name “parabolic bursting” used in earlier studies. 


as in Fig.9.32, do indeed resemble a parabola. But so does the interspike period of a 
“circle/homoclinic” burster. 

To transform the [ya»+J/«-model to a “circle/circle” burster, take the parameters 
in Fig.4.1a so that there is a saddle-node on invariant circle bifurcation when J = 4.51 
(see section 6.1.2). Its nullclines and phase portrait look similar to those in Fig.9.30. 
Then, add one amplifying and one resonant current with gating variables 


Ti dees = CReacien V ) = iMate) / TiadewY |) (slow Inte aio); 
Tistow = (Gsssiaw ¥ } — Nslow)/TK(M)(V ) (slow Ixy), 


having parameters as in Fig.9.33. Note that these equations are uncoupled and hence 
cannot oscillate by themselves without the feedback from variable V. 

Let us describe the bursting mechanism in the full INap+Jk+Jna,slow + J&(my-model 
with J = 5. Since J > 4.51, the resting state of the fast subsystem does not exist, 
and the model generates action potentials, depicted in Fig.9.33a. Each spike activates 
INaslow, Producing even more inward current and, hence, more spikes. This, however, 
activates a much slower K* current (see Fig.9.33b) and produces a net outward current 
that moves the fast nullcline downward and eventually terminates spiking. The tran- 
sition from spiking to resting occurs via saddle-node on invariant circle bifurcation. 
While at rest, both currents deactivate and the fast nullcline slowly moves upward. 
The net inward current, consisting mostly of the injected DC current J = 5, drives the 
fast subsystem via the same saddle-node on invariant circle bifurcation and initiates 
another burst, as shown in Fig.9.33a. 

Using the averaging technique described in section 9.2.3, one can reduce the four- 
dimensional Inap + Ik + INnaslow + JK (my-model to a simpler, two-dimensional slow 
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Figure 9.33: “Circle/circle” bursting in the INap+lk+Inaslow+lK(my-model. Parame- 
ters of the fast INa»+Jk-subsystem are the same as in Fig.4.la with J = 5. Slow Na™ 
current has Vij. = —40 mV, k = 5 mV, gnaslow = 3, TNaslow(V) = 20 ms. Slow Kt 
current has Vi. = —20 mV, k =5 mV, gxmy = 20, Tk (V) = 50 ms. 


TNa,slow +1K(m)-Subsystem of the form (9.4). Bursting of the full model corresponds to 
a limit cycle attractor of the averaged slow subsystem depicted as a bold curve on the 
(Mslow; Nslow) Plane in Fig.9.33c. Superimposed is the projection of the bursting solution 
of the full system (thin, wobbly curve). In Fig.9.33d we project a four-dimensional 
bursting trajectory onto the three-dimensional subspace (V,Msjow, Mslow): 

The Ina pt+lk+Jna,slowt+lk(my-model in Fig.9.33 has a remarkable property: it gen- 
erates slow-wave bursts even though its slow INasiow + Jk a-subsystem consists of 
two uncoupled equations, and hence cannot oscillate by itself! Another example of 
this phenomenon is presented in exercise 12. Thus, the slow wave that drives the fast 
Ivapt+/«-subsystem through the two circle bifurcations is not autonomous: it needs 
feedback from V. In particular, the oscillation will disappear in a voltage-clamp ex- 
periment, that is, when the membrane potential is fixed. 

Now consider a “circle/circle” burster with a slow subsystem performing small- 
amplitude oscillations so that the fast subsystem is always near the saddle-node on 
invariant circle bifurcation. If the slow subsystem has an autonomous limit cycle at- 
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Figure 9.34:  “Circle/circle” bursting 
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tractor that exists without feedback from V, then such a burster can be reduced to the 
Ermentrout-Kopell (1986) canonical model 


o = v4+r(y), if v = +00, then v = —1, (9.8) 
p= w, 


which was originally written in the J-form; see exercise 13. Here, w is the phase of 
autonomous oscillation of the slow subsystem, w * 0 is the frequency of the slow 
oscillation, and r(w) is a periodic function that changes sign and slowly drives the fast 
quadratic integrate-and-fire neuron (9.8) back and forth through the bifurcation, as 
illustrated in Fig.9.34. 

Alternatively, suppose that the slow subsystem cannot have sustained oscillations 
without the fast subsystem, that is, the slow subsystem has a stable equilibrium if v is 
fixed. In exercise 17 we prove that there is a piecewise continuous change of variables 
that transforms any such “circle/circle” burster into one of the two canonical models 
below, depending on the type of equilibrium. If the equilibrium of the slow subsystem 
is a stable node, then the canonical model has the form 


do = I[4+v?+u,-wW, 
Ut = [U1 , (9.9) 
th = —peu2. 


If the equilibrium of the slow subsystem is a stable focus, then the canonical model 
has the form 


0 = I[+v4+u, 
Uy = —p1U2, (9.10) 
ug = —[o(U2 _ U1) ) 


with jig < 4p;. In both cases, there is an after-spike resetting: 


ifv=+oo, then v¢—1, and (wu, U2) © (uy, U2) + (di, do). 


Similar to (9.7), the variable v € R is the re-scaled membrane potential of the neuron. 
The positive feedback variable wu, € R describes activation of slow amplifying currents 
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Figure 9.35: “Circle/circle” bursting in the canonical models (9.9) (top, parameters: 
I=1, wy, = 0.1, pe = 0.02, dy = 1, dp = 0.5) and (9.10) (bottom, parameters: 
l= 1, [1 = 0.2, 2 = 0.1, dy = dy — 0.5). 


or potential at a dendritic compartment, whereas the negative feedback variable uz € R 
describes activation of slow resonant currents. J, d,,dj, and [41, 2 < 1 are parameters. 


When plz > 41, the equilibrium of the slow subsystem in (9.10) is a stable node, 
so (9.10) can be transformed into (9.9) by a linear change of slow variables. If d; = 0, 
then u; > 0 and (9.9) is equivalent to (9.7). 

Both canonical models above exhibit “circle/circle” slow-wave bursting, as depicted 
in Fig.9.35. When J > 0, the equilibrium of the slow subsystem is in the shaded 
area corresponding to spiking dynamics of the fast subsystem. When the slow vector 
(ui, Uz) enters the shaded area, the fast subsystem fires spikes, prevents the vector 
from converging to the equilibrium, and eventually pushes it out of the area. While 
it is outside, the vector follows the curved trajectory of the linear slow subsystem and 
then reenters the shaded area. Such a slow wave oscillation corresponds to the thick 
limit cycle attractor in Fig.9.35, which looks remarkably similar to the one for the 
INapt+lk+Ina,slow+lk(m)-model in Fig.9.33. 
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Figure 9.36: “SubHopf/fold cycle” burster: The middle equilibrium corresponding to 
the resting state loses stability via subcritical Andronov-Hopf bifurcation, and the outer 
limit cycle attractor corresponding to repetitive spiking disappears via fold limit cycle 
bifurcation. The two top images are different views of the same 3-D structure. 


9.3.3. SubHopf/Fold Cycle 


When the resting state loses stability via subcritical Andronov-Hopf bifurcation, and 
the spiking state disappears via fold limit cycle bifurcation, the burster is said to be of 
the “subHopf/fold cycle” type depicted in Fig.9.36. Because there is a coexistence of 
resting and spiking states, such bursting usually occurs via a hysteresis loop with only 
one slow variable. 

This kind of bursting was one of the three basic types identified by Rinzel (1987). It 
was called “elliptic” in earlier studies because the profile of oscillation of the membrane 
potential resembles an ellipse, or at least a half-ellipse; see Fig.9.37. Rodent trigeminal 
interneurons in Fig.9.38, and dorsal root ganglia and mesV neurons in Fig.9.39 are 
“subHopf/fold cycle” bursters, yet the bursting profiles do not look like ellipses. Many 
models of “subHopf/fold cycle” bursters do not generate elliptic profiles either; hence, 
referring to this type of bursting by its shape is misleading and should be avoided. 

It is quite easy to transform the Iya,p)+J«-model into a “subHopf/fold cycle” burster. 
First, we chose the parameters of the model as in Fig.6.16, so that the phase portrait 
depicted in Fig.9.40 is the same as in Fig.9.36 (bottom). The coexistence of the stable 
equilibrium, an unstable limit cycle, and a stable limit cycle is essential for producing 
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Figure 9.37: Phase portrait and solution of the canonical model (9.11) for p = 0.1, w = 
3, and a = 0.25 (top) and a = 0.8 (bottom), where r = |z] is the ae of oscdintion 
(modified from Izhikevich 2000b). 
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Figure 9.38: Putative “subHopf/fold cycle” bursting in rodent trigeminal neurons. 
(Modified from Del Negro et al. 1998.) 


Figure 9.39: Putative “subHopf/fold cycle” bursting in (a) injured dorsal root ganglion 
(data modified from Jian et al. 2004) and in (b) rat mesencephalic layer 5 neurons. 
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Andronov-Hopf bifurcation and 
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the hysteresis loop oscillation. Then, we add a slow K* M-current that activates while 
the fast subsystem fires spikes, and deactivates while it is resting. Such a resonant cur- 
rent provides a negative feedback to the fast subsystem, and the full Inap+Jk+Jkcmy- 
model exhibits “subHopf/fold cycle” bursting, shown in Fig.9.41. 

As in the previous examples, the burster in this figure is conditional: it needs 
an injection of a DC current J, so that the equilibrium corresponding to the resting 
state of the fast subsystem is unstable. If the subsystem is near such an equilibrium, 
it slowly diverges from the equilibrium and jumps to the large-amplitude limit cycle 
attractor corresponding to spiking behavior, as one can see in Fig.9.4la. Each spike 
activates a slow Kt M-current, see Fig.9.41b, and results in the buildup of a net outward 
current that makes the fast subsystem less and less excitable. Geometrically, the large- 
amplitude limit cycle attractor is approached by a smaller-amplitude unstable limit 
cycle; they coalesce, and annihilate each other via fold limit cycle bifurcation at nsjow © 
0.14; see Fig.9.41c. The trajectory jumps to the stable equilibrium corresponding to 
the resting state. At this moment, the slow Kt current starts to deactivate, and the 
net outward current decreases. Since the activation gate nsjoy moves in the opposite 
direction, the fold limit cycle bifurcation gives birth to large-amplitude stable and 
unstable limit cycles, but the trajectory remains on the steady-state branch. The 
unstable limit cycle slowly shrinks, and makes the resting equilibrium lose stability via 
subcritical Andronov-Hopf bifurcation. Once the resting state becomes unstable, the 
trajectory diverges from it and jumps back to the large-amplitude limit cycle, thereby 
closing the hysteresis loop. 

A prominent feature of “subHopf/fold cycle” bursting, as well as any other type 
of fast-slow bursting involving Andronov-Hopf bifurcation (“subHopf/*” or “Hopf/*”, 
where the wild card “*” means any bifurcation) is that the transition from resting to 
spiking does not occur at the moment the resting state becomes unstable. The fast 
subsystem remains at the unstable equilibrium for quite some time before it jumps 
rather abruptly to a spiking state, as we can clearly see in Fig.9.41. This delayed 
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Figure 9.41: “SubHopf/fold cycle” bursting in the INap+J«K+Jkmy-model. Parameters 
of the fast INapt+Jx-subsystem are the same as in Fig.6.16 with J = 55. Slow Kt 
M-current has Vi/2 = —20 mV, k = 5 mV, 7(V) = 60 ms, and gxywy = 1.5. 


transition is due to the slow passage through Andronov-Hopf bifurcation, discussed in 
section 6.1.4. Delayed transitions through Andronov-Hopf bifurcation are ubiquitous 
in neuronal models, but they have never been seen in real neurons. Conductance noise, 
always present at physiological temperatures, constantly kicks the membrane potential 
away from the stable equilibrium, as one can see in the inset in Fig.9.38, so transition 
to spiking in real neurons is never delayed. Instead, it can occur even before the 
equilibrium becomes unstable, as we show in section 6.1.4. 


Suppose that the hysteresis loop oscillation of the slow variable has a small am- 
plitude. That is, the subcritical Andronov-Hopf bifurcation and the fold limit cycle 
bifurcation of the fast subsystem in (9.1) occur for nearby values of the parameter 
u. In this case, the fast subsystem is near a codimension-2 Bautin bifurcation, which 
was studied in section 6.3.5. Its two-parameter unfolding is depicted in Fig.9.42 (left). 
“SubHopf/fold cycle” bursting occurs when the bifurcation parameter, being a slow 
variable, oscillates between the resting and spiking regions through the shaded area. 
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Figure 9.42: A neural system near codimension-2 Bautin bifurcation (central dot) can 
exhibit four different types of fast-slow bursting, depending on the trajectory of the 
slow variable u € R? in the parameter space. The “subHopf/fold cycle” bursting 
occurs via a hysteresis loop and requires only one slow variable. Solid (dotted) lines 
correspond to spiking (resting) regimes. (Modified from Izhikevich 2000a.) 


Due to the bistability, the parameter could be one-dimensional. Other trajectories of 
the slow parameter correspond to other types of bursting shown in Fig.9.42 (right). 

If the slow variable has an equilibrium near the Bautin bifurcation point, then the 
fast-slow burster (9.1) can be transformed into the following canonical “2+1” model 
by a continuous change of variables 


2 = (utiw)z+ 22\2/? — 2I2\, 


ua — |zP), on 


where z € C and u € R are the canonical fast and slow variables, respectively, and 
a,w, and wy < 1 are parameters. In exercise 14 we show that the model exhibits 
the hysteresis loop periodic point-cycle bursting behavior depicted in Fig.9.37 when 
0<a<l. 
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Figure 9.43: “Fold/fold cycle” bursting. The resting state disappears via saddle-node 


(fold) bifurcation, and the spiking limit cycle disappears via fold limit cycle bifurcation. 
(Modified from Izhikevich 2000a.) 


9.3.4 Fold/Fold Cycle 


When the stable equilibrium corresponding to the resting state disappears via saddle- 
node (fold) bifurcation and the limit cycle attractor corresponding to the spiking state 
disappears via fold limit cycle bifurcation, the burster is said to be of the “fold/fold 
cycle” type, as in Fig.9.43. This type was first discovered in the Chay-Cook (1988) 
model of a pancreatic G-cell by Bertram et al. (1995), who referred to it as being 
Type IV bursting (the three bursters we have considered so far are referred to as 
being Types I, II, and II). Since both bifurcations result in a coexistence of resting 
and spiking states, the “fold/fold cycle” bursting can occur via a hysteresis loop in a 
“2+1” system. 

An interesting geometrical feature of the “fold/fold cycle” bursting is that an un- 
stable limit cycle appears in the middle of a burst and participates in the “fold cycle” 
bifurcation to terminate the burst. The cycle appears via saddle homoclinic orbit bi- 
furcation in Fig.9.43, but other scenarios are possible. It is a good exercise of one’s 
geometrical intuition and understanding of the fast-slow bursting mechanisms to de- 
velop alternative scenarios of the “fold/fold cycle” bursting. For example, consider the 
case of the unstable limit cycle being inside the stable one. 
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Figure 9.44: “Fold/Hopf” bursting: The resting state disappears via saddle-node (fold) 
bifurcation, and the spiking limit cycle shrinks to a point via supercritical Andronoy- 
Hopf bifurcation. (Modified from Izhikevich 2000a.) 


9.3.5 Fold/Hopf 


When the stable equilibrium corresponding to the resting state disappears via saddle- 
node (fold) bifurcation and the limit cycle attractor corresponding to the spiking state 
shrinks to a point via supercritical Andronov-Hopf bifurcation, the burster is said to be 
of the “fold/Hopf” type (see Fig.9.44). This type of bursting, called “tapered” in some 
earlier studies, was found in models of insulin-producing pancreatic 6-cells (Smolen et 
al. 1993; Pernarowski 1994) and in models of certain enzymatic systems (Holden and 
Erneux 1993a, 1993b). 


As one can see in the figure, the fast subsystem undergoes two bifurcations while 
in the excited state: One corresponds to the termination of repetitive spiking via 
supercritical Andronoy-Hopf bifurcation, and the other corresponds to the transition 
from the excited equilibrium to resting equilibrium via saddle-node (fold) bifurcation. 
The first bifurcation (i.e., bifurcation of a spiking limit cycle attractor) determines the 
topological type of bursting. The second bifurcation is essential for the “fold/fold” 
hysteresis loop, and it determines only the subtype of the “fold/Hopf” bursting. Using 
ideas described in exercise 19, one can come up with another subtype of “fold/Hopf” 
burster having a “fold/subHopf” hysteresis loop. 
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Figure 9.45: “Fold/circle” bursting: The resting state disappears via fold bifurcation 
and the spiking state disappears via saddle-node on invariant circle bifurcation. (Mod- 
ified from Izhikevich 2000a.) 


9.3.6 Fold/Circle 


When the stable equilibrium corresponding to the resting state disappears via saddle- 
node (fold) bifurcation and the limit cycle attractor corresponding to the spiking state 
disappears via saddle-node on invariant circle bifurcation, the burster is said to be of 
the “fold/circle” type (see Fig.9.45). This type was first discovered in the model of the 
thalamocortical relay neuron by Rush and Rinzel (1994), and it was called “triangular” 
in earlier studies (Wang and Rinzel 1995) because of the shape of the voltage envelope. 

As one can see in the figure, the fast subsystem can have five equilibria, two of which 
are stable nodes. This is a consequence of the quintic shape of the V-nullcline of the 
fast subsystem. While the trajectory is at the lower equilibrium, the V-nullcline moves 
upward, the equilibrium disappears via fold bifurcation, and the fast subsystem starts 
to fire spikes. During this active period, the V-nullcline slowly moves downward, and 
the spiking limit cycle disappears via saddle-node on invariant circle bifurcation. The 
fast subsystem, however, is at the second stable equilibrium corresponding to a depo- 
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larized state. The slow V-nullcline continues to move downward, and this equilibrium 
disappears via another fold bifurcation, thereby closing the “fold/fold” hysteresis loop. 
Alternatively, “fold/circle” bursting can be of the slow-wave type, depicted in Fig.9.28 
having only three equilibria. The slow subsystem needs to be at least two-dimensional 
in this case, however. 


9.4 Neurocomputational Properties 


There is more to the topological classification of bursters than just a mathematical 
exercise. Indeed, in chapter 7 we showed that the neurocomputational properties of 
an excitable system depend on the type of bifurcation of the resting state. The same 
is valid for a burster: its neurocomputational properties depend on the kinds of bi- 
furcations of the resting and spiking states, that is, on the burster’s type. Knowing 
the topological type of a given bursting neuron, we know what the neuron can do - 
and, more importantly, what it cannot do — regardless of the model that describes its 
dynamics. 


9.4.1 How to Distinguish? 


First, we stress that the topological classification of bursters provided in the previous 
section is defined for mathematical models, and not for real neurons. Moreover, the 
types are defined for models of the fast-slow form (9.1) assuming that the ratio of time 
scales, 44, is sufficiently small. Not all neurons can be described adequately by such 
models, so extending the classification to those neurons may be worthless. A typical 
example of classification failure is the model of bursting of the sensory processing 
neuron in weakly electric fish, known as the “ghostburster” (Doiron et al. 2002), in 
which pu > 0.1. 

If a bursting neuron can be described accurately by a model having a fast-slow form 
(9.1), then there is no problem in determining its topological type — just freeze the slow 
subsystem, that is, set 4 = 0, and find bifurcations of the fast subsystem treating u 
as a parameter. Software packages such as XPPAUT, AUTO, and MATLAB-based 
MATCONT, are helpful in bifurcation analyses of such systems. 

What if a neuron has an apparent fast-slow dynamics but its model is not known 
at present? To determine the types of bifurcations of the fast subsystem, we first 
use noninvasive observations: presence or absence of fast subthreshold oscillations, 
changes in intraburst (interspike) frequency, changes in spike amplitudes, and so on. 
Each piece of information excludes some bifurcations and narrows the set of possible 
types of bursting. Then, we can use invasive methods, e.g., small perturbations, to 
test the coexistence of resting and spiking states, and narrow the choice of bifurcations 
further. With some luck, we can exclude enough bifurcations and determine exactly the 
type of bursting without knowing the details of the mathematical model that describes 
it. 
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9.4.2 Integrators vs. Resonators 


A conspicuous feature of neuronal systems near Andronov-Hopf bifurcation, whether 
subcritical or supercritical, is the existence of fast subthreshold oscillations of the 
membrane potential. Quite often, these oscillations are visible in recordings of the 
membrane potential. If they are not, then they can be evoked by a brief, small pulse 
of current. Apparently, a bursting neuron exhibiting such oscillations in the quiescent 
state is either of the “Hopf/*” type or of the “subHopf/*” type, where the wild card 
“*” denotes any appropriate bifurcation of the spiking state. All such bursters are in 
the lower half of Fig.9.23. 

To discern whether the bifurcation is supercritical or subcritical, one needs to study 
the amplitude of emerging oscillations, which can be tricky. In models, slow passage 
through supercritical Andronov-Hopf bifurcations often results in a delayed transition 
to oscillations with an intermediate or large amplitude; hence such a bifurcation may 
look like a subcritical one. In recordings like the ones in Fig.9.39a and Fig.9.46, noise 
destabilizes the focus equilibrium before the subcritical Andronov-Hopf bifurcation 
takes place and gives the impression that the amplitude increases gradually, that is, as 
if the bifurcation were supercritical. 

The existence of fast subthreshold oscillations indicates that the bursting neuron 
acts as a resonator, at least right before the onset of a burst. In section 7.2.2 we showed 
that such neurons prefer a certain resonant frequency of stimulation that matches the 
frequency of subthreshold oscillations. A resonant input may excite the neuron and 
initiate a burst, or it may delay the transition to the burst, depending on its phase 
relative to the phase of subthreshold oscillations. 

In contrast, all bursters in the upper half of the table in Fig.9.23 (i.e., “fold/*” and 
“circle/*” types) do not have fast subthreshold oscillations, at least before the onset of 
each burst (see exercise 5). The fast subsystem of such bursters acts as an integrator: 
it prefers high-frequency inputs; the higher the frequency, the sooner the transition to 
the spiking state. The phase of the input does not play any role here. 


9.4.3 Bistability 


Suppose the transition from resting to spiking state occurs via saddle-node bifurcation 
(off an invariant circle) or subcritical Andronov-Hopf bifurcation of the fast subsystem, 
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as in Fig.6.46. In these cases, the trajectory jumps to a preexisting limit cycle attractor 
corresponding to the spiking state (not shown in the figure). In contrast, saddle-node 
on invariant circle bifurcation or supercritical Andronov-Hopf bifurcation creates such 
a limit cycle attractor. Thus, there must be a coexistence of stable resting and stable 
spiking states in the former case, but not necessarily in the latter case. This simple 
observation has far-reaching consequences described below. In particular, it implies 
that all “fold/*” and “subHopf/*” bursters exhibit bistability, at least before the onset 
of a burst, while “circle/*” and “Hopf/*” bursters may not (see Fig.9.47). 


Similarly, if the transition from spiking to resting state of the fast subsystem occurs 
via saddle homoclinic orbit bifurcation or fold limit cycle bifurcation, then there is a 
preexisting stable equilibrium, and hence a coexistence of attractors. Thus, “*/homo- 
clinic” and “*/fold cycle” bursters also exhibit bistability, at least at the end of a burst, 
while “*/circle” and “*/Hopf” bursters may not, as we summarize in Fig.9.47. 


An obvious consequence of bistability is that an appropriate stimulus can switch the 
system from resting to spiking and back. We illustrate this phenomenon in Fig.9.48, 
using the INaptJk+Jkcmy-model, which exhibits a hysteresis loop “fold/homoclinic” 
bursting when J = 5. All three simulations in the figure start with the same initial 
conditions. In Fig.9.48b we apply a brief pulse of current while the fast subsystem is at 
the resting state. This stimulation pushes the membrane potential over the threshold 
state into the attraction domain of the spiking limit cycle of the fast subsystem, thereby 
evoking a burst. 

Note that the evoked burst is one spike shorter than the control burst in Fig.9.48a. 
This is expected, since the K* M-current did not have enough time to recover from 
the previous burst (not shown in the figure); therefore, there is a residual outward 
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Figure 9.48: Bistability of resting and spiking states in a “fold/homoclinic” burster. A 
brief stimulus can initiate a premature transition to the spiking state (b) or to quiescent 
state (c). Shown are simulations of the INap»+Jk+JKmy-model with parameters as in 
Fig.9.4b. 


current that shortens the active phase. From the geometrical point of view, this occurs 
because the transition to the spiking manifold in Fig.9.48b (right) occurs before the 
slow variable reaches the fold knee; hence the distance to the homoclinic bifurcation is 
shorter. An interesting observation is that the first spike in the evoked burst actually 
corresponds to the second spike in the control burst in Fig.9.48a. The earlier the 
stimulation acts, the sooner the trajectory jumps to the spiking manifold and the 
fewer spikes the evoked burst has. 

In Fig.9.48c we applied a brief pulse of current in the middle of a burst to switch 
the system to the resting state. Note that the quiescent period, that is, the time to 
the second burst, is shorter than the control period in Fig.9.48a or 9.48b. This is also 
to be expected, since the Kt M- current was not fully activated during the interrupted 
burst and therefore does not need much time to deactivate during the resting period. 
Geometrically, the short duration of the resting phase is a consequence of the distance 
the slow variable needs to travel to get to the fold knee being small. 
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9.4.4 Bursts as a Unit of Neuronal Information 


There are many hypotheses on the importance of bursting activity in neural computa- 
tion (Izhikevich 2006). 


Bursts are more reliable than single spikes in evoking responses in postsynaptic 
cells. Indeed, excitatory post-synaptic potentials (EPSP) from each spike in a 
burst add up and may result in a superthreshold EPSP. 


Bursts overcome synaptic transmission failure. Indeed, postsynaptic responses to 
a single presynaptic spike may fail (release does not occur), however in response 
to a bombardment of spikes, i.e., a burst, synaptic release is more likely (Lisman 
1997). 


Bursts facilitate transmitter release whereas single spikes do not (Lisman 1997). 
Indeed, a synapse with strong short-term facilitation would be insensitive to 
single spikes or even short bursts, but not to longer bursts. Each spike in the 
longer burst facilitates the synapse so the effect of the last few spikes may be 
quite strong. 


Bursts evoke long-term potentiation and hence affect synaptic plasticity much 
greater, or differently than single spikes (Lisman 1997). 


Bursts have higher signal-to-noise ratio than single spikes (Sherman 2001). In- 
deed, burst threshold is higher than spike threshold, i.e., generation of bursts 
requires stronger inputs. 


Bursts can be used for selective communication if the postsynaptic cells have 
subthreshold oscillations of membrane potential. Such cells are sensitive to the 
frequency content of the input. Some bursts resonate with oscillations and elicit 
a response, others do not, depending on the interburst frequency (Izhikevich et 
al. 2003). 


Bursts can resonate with short-term synaptic plasticity making a synapse a band- 
pass filter (Izhikevich et al. 2003). A synapse having short-term facilitation and 
depression is most sensitive to a burst having certain resonant interspike fre- 
quency. Such a burst evokes just enough facilitation, but not too much depres- 
sion, so its effect on the postsynaptic target is maximal. 


Bursts encode different features of sensory input than single spikes (Gabbiani et 
al. 1996, Oswald et al. 2004). For example, neurons in the electrosensory lateral- 
line lobe (ELL) of weakly electric fish fire network induced-bursts in response to 
communication signals and single spikes in response to prey signals (Doiron et 
al. 2003). In the thalamus of the visual system bursts from pyramidal neurons 
encode stimuli that inhibit the neuron for a period of time and then rapidly excite 
the neuron (Lesica and Stanely, 2004). Natural scenes are often composed of such 
events. 
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Figure 9.49: The instantaneous spike frequency of a trigeminal motor neuron (a) and 
a trigeminal interneuron (b) of a rodent. (Modified from Del Negro et al. 1998.) 


e Bursts have more informational content than single spikes when analyzed as 
unitary events (Reinagel et al. 1999). This information may be encoded into the 
burst duration or in the fine temporal structure of interspike intervals within a 
burst. 


In summary, burst input is more likely to have a stronger impact on the postsynaptic 
cell than single spike input, so some believe that bursts are all-or-none events, whereas 
single spikes may be noise. 


9.4.5 Chirps 


An important information may be carried in the intraburst frequency. Consider the 
effect of a burst on a postsynaptic resonator neuron, that is, a neuron with a resting 
state near an Andronoy-Hopf bifurcation. Such a neuron is sensitive to the frequency 
content of the burst (i-e., whether it is resonant or not, as discussed in section 7.2.2). 
Some types of bursters have relatively constant intraburst (instantaneous interspike) 
frequencies, as in Fig.9.49b, which may be resonant for some postsynaptic neurons 
but not for others. In contrast, other topological types of bursters have widely vary- 
ing instantaneous interspike frequencies, as in Fig.9.49a, that scan or sweep a broad 
frequency range going all the way to zero. 

When the bifurcation from resting to spiking state is of the saddle-node on invariant 
circle type (i.e., the system is Class 1 excitable), the frequency of emerging spiking is 
first small, and then increases. Therefore, all “circle/*” bursters generate chirps with 
instantaneous interspike frequencies increasing from zero to a relatively large value, 
at least at the beginning of the burst. Similarly, when the bifurcation of the spiking 
state is of the saddle-node on invariant circle or saddle homoclinic orbit type, the 
frequency of spiking at the end of the burst decreases to zero, so all “*/circle” and 
“*/homoclinic” bursters also generate chirps, as in Fig.9.49a. In summary, all shaded 
bursters in Fig.9.50 have sweeping interspike frequencies, so that one part of the burst 
is resonant for one neuron and another part of the same burst is resonant for another 
neuron. 
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Figure 9.50: Topological types of bursters in the shaded regions can produce chirp- 
bursts that sweep a frequency range. 


9.4.6 Synchronization 


Consider two coupled bursting neurons of the fast-slow type. Since each burster has 
two time scales, one for rhythmic spiking and one for repetitive bursting, there are two 
synchronization regimes: 


e Spike synchronization, as in Fig.9.51 (left). 
e Burst synchronization, as in Fig.9.51 (right). 


One of them does not imply the other. Of course, there is an additional regime in 
which spikes and bursts are synchronized. We will study synchronization phenomena 


spike synchronization burst synchronization 


Figure 9.51: Various regimes of synchronization of bursters. 
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Figure 9.52: Burst synchronization and desynchronization of two coupled 


“fold/homoclinic” bursters. (Modified from Izhikevich 2000a.) 


in detail in chapter 10; here we just mention how they depend on the topological type 
of bursting. 

Let us consider spike synchronization first. Since we are interested in the fast time 
scale, we neglect the slow variable dynamics for now and treat two bursters as coupled 
oscillators. A necessary condition for synchronization of two weakly coupled oscillators 
is that they have nearly equal frequencies. How near is “near” depends on the strength 
of the coupling. Thus, spike synchronization depends crucially on the instantaneous 
interspike frequency, which may vary substantially during a burst. Indeed, a small 
perturbation of the slow variable may result in large perturbations of the interspike 
frequency in any shaded burster in Fig.9.50; hence such a burster would be unlikely to 
exhibit spike synchronization unless the coupling is strong. 

Studying burst synchronization of weakly coupled neurons involves the same mathe- 
matical methods as studying synchronization of strongly coupled relaxation oscillators, 
which we consider in detail in chapter 10. The mechanisms of synchronization depend 
on whether the bursting is of the hysteresis loop type or of the slow wave type, and 
whether the resting state is an integrator or a resonator. 

In Fig.9.52 we illustrate the geometry of burst synchronization of two coupled 
“fold/homoclinic” bursters of the hysteresis loop type. Burster A is slightly ahead 
of burster B, so that A starts the spiking phase while B is still resting. If the synaptic 
connections between the bursters are excitatory, firing of A causes B to jump to the 
spiking state prematurely, thereby shortening the time difference between the bursts. 
In addition, the evoked burst of B is shorter, which also speeds up the synchroniza- 
tion process. In contrast, when the connections are inhibitory, firing of A delays the 
transition of B to the spiking state, thereby increasing the time difference between 
the bursts and desynchronizing the bursters. Thus, the “fold/homoclinic” burster be- 
haves according to the principle excitation means synchronization, inhibition means 
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desynchronization. Since the instantaneous interspike frequency of “fold/homoclinic” 
bursting decays to zero, small deviations of the slow variable result in large deviations 
of the period of oscillation. Typically, the periods of fast oscillations of the two bursters 
can diverge slowly from each other. As a result, spikes may start synchronized and 
then desynchronize during the burst, as we indicate in the figure. 


If the bursting neuron is a resonator, that is, it is of the “Hopf/*” or “subHopf/*” 
type, then both excitation and inhibition may evoke premature spiking, as we have 
shown in chapter 7, and lead to burst synchronization. An important feature here 
is that the interspike frequency of one burster must be resonant to the subthreshold 
oscillations of the other one. We study these and other issues related to synchronization 
in chapter 10. 


Review of Important Concepts 


e A burst of spikes is a train of action potentials followed by a period 
of quiescence. 


Bursting activity typically involves two time scales: fast spiking and 
slow modulation via a resonant current. 


Many mathematical models of bursters have the fast-slow form 


es) (fast spiking), 
ie = gla) (slow modulation). 


To dissect a burster, one freezes its slow subsystem (i.e., sets uy = 0) 
and uses the slow variable u as a bifurcation parameter to study the 
fast subsystem. 


The fast subsystem undergoes two important bifurcations during a 
burst: (1) bifurcation of an equilibrium resulting in transition to the 
spiking state and (2) bifurcation of a limit cycle attractor resulting in 
transition to the resting state. 


Different types of bifurcations result in different topological types of 
bursting. 


There are 16 basic types of bursting, summarized in Fig.9.23. 


Different topological types of bursters have different neurocomputa- 
tional properties. 
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Figure 9.53: Bifurcation mechanisms and classical nomenclature of the six bursters 
known in the twentieth century. Compare with Fig.9.23 and Fig.9.24. 


Bibliographical Notes 


The history of formal classification of bursting starts with the seminal paper by Rinzel 
(1987), who contrasted the bifurcation mechanisms of the “square-wave”, “parabolic”, 
and “elliptic” bursters. Bertram et al. (1995) followed Rinzel’s suggestion and referred 
to the bursters using Roman numerals, adding a new burster, Type IV. Another, 
“tapered” type of bursting was studied simultaneously and independently by Holden 
and Erneux (1993a, 1993b), Smolen et al. (1993), and Pernarowski (1994). Later, 
de Vries (1998) suggested referring to it as a Type V burster. A “triangular” type of 
bursting was studied by Rush and Rinzel (1994), making the total of identified bursters 
six. To honor these pioneers, we described these six classical bursters in the order of 
the numbering of Bertram et al. (1995). Their bifurcation mechanisms are summarized 
in Fig.9.53. 

The complete classification of bursters, provided by Izhikevich (2000a), was moti- 
vated by Guckenheimer et al. (1997). There is a drastic difference between Izhikevich’s 
approach and that of the scientists mentioned above. The latter used a bottom-up 
approach; that is, they considered biophysically plausible conductance-based models 
describing experimentally observable cellular behavior, then determined the types of 
bursting these models exhibited. In contrast, Izhikevich (2000a) used the top-down 
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Figure 9.54: A hedgehog-like limit cycle attractor results in bursting dynamics even in 
two-dimensional systems; see exercise 1. (Modified from Hoppensteadt and Izhikevich 
1997.) 


approach and considered all possible pairs of codimension-1 bifurcations of rest and 
spiking states, which resulted in different types of bursting. (It was an easy task to 
provide a conductance-based model exhibiting each bursting type.) Thus, many of the 
bursters are “theoretical” in the sense that they have yet to be seen in experiments. 

A challenging problem was to suggest a naming scheme for the bursters. The 
names should be self-explanatory, and easy to remember and understand. Thus, the 
numbering scheme suggested by Bertram et al. (1995) could lead to bursters of Type 
XXVI, Type LXIII, Type CLXVI, and so on. We cannot use descriptions such as 
“elliptic”, “parabolic”, “hyperbolic”, “triangular”, “rectangular”, and such because 
they are misleading. In this book we follow Izhikevich (2000a) and name the bursters 
according to the two bifurcations involved, as in Fig.9.23. 

Not all bursters can be represented in the fast-slow form with a clear separation of 
the time scales. Those that cannot, are referred to as hedgehog bursters (Izhikevich 
2000a), since they have a limit cycle (or a more complicated attractor) with some 
spiky parts corresponding to repetitive spiking and some smooth parts corresponding 
to quiescence, as in Fig.9.54. An interesting example of the hedgehog burster is the 
model of the sensory processing neuron of weakly electric fish (Doiron et al. 2002). The 
authors refer to the model as “ghostburster” because repetitive spiking corresponds to 
a slow transition of the full system through the ghost of a fold limit cycle attractor. 
As a dynamical system, the ghostburster is near a codimension-2 bifurcation of limit 
cycle attractor, and it exhibits chaotic dynamics. 

Betram et al. (1995) noticed that bursting often occurs when the fast subsystem 
is near a codimension-2 bifurcation. Izhikevich (2000a) suggested that many simple 
models of bursters could be obtained by considering unfoldings of various degenerate 
bifurcations of high codimension (organizing centers) and treating the unfolding param- 
eters as slow variables rotating around the bifurcation point, as in Fig.9.28 or Fig.9.42. 
Considering the Bautin bifurcation, Izhikevich (2001) obtained the canonical model for 
the “subHopf/fold cycle” (“elliptic”) burster (9.11). Golubitsky et al. (2001) applied 
this idea to other local bifurcations (spiking with infinitesimal amplitude). Global 
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bifurcations are considered in exercise 26. 

Izhikevich and Hoppensteadt (2004) extend the classification of bursters to one- and 
two-dimensional mappings, identifying 3 and 20 different classes, respectively. A recent 
book Bursting: The Genesis of Rhythm in the Nervous System edited by Coombes and 
Bressloff (2005), presents recent developments in the field of bursting dynamics. 

Studying bursting dynamics is still one of the hardest problems in applied math- 
ematics. The method of dissection of fast-slow bursters of the form (9.1), pioneered 
by Rinzel (1987), is part of the asymptotic theory of singularly perturbed dynamical 
systems (Mishchenko et al. 1994). One would expect the theory to suggest other, 
quantitative methods of analyzing fast-slow bursters. However, the basic assumption 
of the theory is that the fast subsystem has only equilibria, e.g., up- and down-states, 
as in the point-point hysteresis loops in exercise 19. This assumption is violated when 
the neuron fires a burst of spikes, since repetitive spikes correspond to limit cycles. 
Thus, the theory is of no help in studying fast-slow point-cycle bursters. An excep- 
tion is Pontryagin’s problem, which is related to “fold cycle/fold cycle” bursting; see 
exercise 21 and section 7 in Mishchenko et al. (1994). Pontryagin and Rodygin (1960) 
pioneered the method of averaging of the fast subsystem, which was used in the context 
of bursters by Rinzel and Lee (1986), Pernarowski et al. (1992), Smolen et al. (1993), 
and Baer et al. (1995). Shilnikov et al. (2005) introduced an average nullcline of the 
slow subsystem, and showed how the averaging method can be used to study coexis- 
tence of spiking and bursting states in a model neuron, and bifurcations in bursters in 
general. Some of the transitions “resting < bursting < tonic spiking” were considered 
by Ermentrout and Kopell (1986a), Terman (1991), Destexhe and Gaspard (1993), 
Shilnikov and Cymbalyuk (2004, 2005), and Medvedev (2005). 

The averaging method, like many other classical methods of analysis of dynamical 
systems, breaks down when the fast subsystem slowly passes a bifurcation point. The 
development of early dynamical system theory was largely motivated by studies of 
periodic oscillators. It is reasonable to expect that the next major developments of 
this theory will come from studies of bursters. 


Exercises 


1. (Planar burster) Invent a planar system of ODEs having a hedgehog limit cycle 
attractor (as in Fig.9.54) and capable of exhibiting periodic bursting activity. 


2. (Noise-induced bursting) Explain why the Jya»+/«K-model with a phase portrait 
as in Fig.9.55 bursts even though it has only two dimensions. 


3. (Noise-induced bursting) Explore numerically the Iya)»+J«-model with phase 
portrait as in Fig.6.7 (top) and make it burst as in Fig.9.56, without adding 
any new current or gating variable. 


4, (Rebound bursting) Explain the mechanism of rebound bursting in the two- 
dimensional FitzHugh-Nagumo oscillator (4.11, 4.12), shown in Fig.9.57. 
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Bursting in two-dimensional [ya,+/«K-model with parameters as in 


Figure 9.56: Bursting in a_two- 
dimensional [ap +J«-model; see 
exercise 3. 
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Figure 9.57: Rebound bursting in the FitzHugh-Nagumo oscillator; see exercise 4. 
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‘ Figure 9.58: Hopf/Hopf bursting 
without coexistence of attractors; 
see exercise 6. (Modified from Hop- 
pensteadt and Izhikevich 1997.) 


. Can “circle/*” and “fold/*” bursters have fast subthreshold oscillations of mem- 


brane potential? Explain. 


. (Hopf/Hopf bursting) The system 


e=(y+ije—2lz), L=at+im€EC, 


has a unique attractor for any value of the parameter y € R. If 
1 
y= w(2a5(2 —a)—|2|), p= 0.05, a= V/u/20, and S(u) = a 
a e* 
then the “2+1” system above can burst, as we show in Fig.9.58. Explore the 
system numerically and explain the origin of bursting. 


. (Hopf/Hopf canonical model) Consider the “2+1” fast-slow burster (9.1) and 


suppose that 29 is the supercritical Andronov-Hopf bifurcation point of the fast 
subsystem when u = up. Also suppose that uo is a stable equilibrium of the 
slow subsystem when x = Zo is fixed. Show that there is a continuous change of 


variables that transforms (9.1) into the canonical model 
2 = (utiw)z—2|2|?, 
uw = p(tl+u-—alz|’), 


where z € C is the new fast variable, u € R is a slow variable, and w,a, and yu 
are parameters. 


. (Bursting in the Inatt+JNasiow-model) Take advantage of the phenomenon of 


inhibition-induced spiking described in section 7.2.8 to show that a slow per- 
sistent inward current, say [Na siow, Can stop spiking and create bursts. 


. Modify the example above to obtain repetitive bursting in a model consisting of 


a fast Iya Current, a leak current, and a slow passive dendritic compartment. 


(Bursting in the Iya p+k+JnNa,slow-model) Numerically explore this model with a 
fast subsystem as in Fig.6.16 and a slow Na* current with parameters gna slow = 
0.5, Mooslow(V) with Viy2 = —50 mV and k = 10 mV, and Taow(V) = 5 + 
100 exp(—(V + 20)?/25"). Explain the origin of bursting oscillations when J = 27 
in Fig.9.59. 
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Figure 9.59: Bursting in the 
50 100 150 200 250 300 350 INa,ptIk+Jnaslow-model; see exer- 
time (ms) cise 10. 


1 Figure 9.60: The phase 
- portrait of the system in 
_ exercise 11 shows that 


there is only one stable 
equilibrium for any value 
I(t) ot ad. Nevertheless, the 
system bursts when I is 


it, 


1. 


13. 


periodically modulated. 


3 0 200 400 600 


The Bonhoeffer—van der Pol oscillator 


t=I+2-2°/3-y, 
j = 0.2(1.05 +2) , 


with nullclines as in Fig.9.60, is Class 3 excitable. It has a unique stable equilib- 
rium for any value of J. Periodic modulations of J shift the x-nullcline upward 
and downward but do not change the stability of the equilibrium. Why does the 
system burst in Fig.9.60? Explore the phenomenon numerically and explain the 
existence of repetitive spikes without a limit cycle. 


Prove (without simulations) that the fast-slow “2+2” system 


(ltutiw)z—2|z|?, ret. 


u(u-—u—w), 


w(\z/? — 1), 


is a slow-wave burster, even though the slow subsystem cannot oscillate for any 
fixed value of the fast subsystem z. 


& & aw 
rl 


(Ermentrout and Kopell 1986) Consider the system 


8B = 1—cosd+(1+cos¥)r(y) , 
p= w, 
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Bursting 


with 3 and 7 being phase variables on the unit circle S' and r(q) being any 
continuous function that changes sign. Show that this system exhibits bursting 
activity when w is sufficiently small but positive. What type of bursting is that? 


Prove that the canonical model for “subHopf/fold cycle” bursting (9.11) exhibits 
sustained bursting activity when 0 < a < 1. What happens when a approaches 
0 or 1? 


Show that the canonical model for “fold/homoclinic” bursting (9.7) is equivalent 
to a simpler model (equation 27 in Izhikevich 2000a and chapter 8 in this volume), 


0 vtw, 

w= pb; 
with after-spike (v = +00) resetting v < 1 and w «+ w—d, when J is sufficiently 
large and p and d are sufficiently small. 


Derive the canonical model for “fold/homoclinic” bursting (9.7), assuming that 
the fast subsystem is near a saddle-node homoclinic orbit bifurcation point at 
some u = Uo, which is an equilibrium of the slow subsystem. 


Derive the canonical models (9.9) and (9.10) for “circle/circle” bursting. 


Show that the averaged slow subsystems of the canonical models for “circle/circle” 
bursters (9.9) and (9.10) have the form 


ty = —piurtdf(l+u — ue), 
Ug = pote +dof(I+u1 — ug), 
and 
ty = —pyuet+ di f(l+u), 


e. 
two 
| 


—H2(u2 — us) + dof(T + ui) , 
respectively, where 
fu) = — v4 
m/2+ arcot Ju 
is the frequency of spiking of the fast subsystem (in Hz). 


(Point-point hysteresis loops) Consider (9.1) and suppose that the fast subsystem 
has only equilibria for any value of the one-dimensional slow variable u. If there is 
a coexistence of equilibrium points of the fast subsystem, then (9.1) can exhibit 
point-point hysteresis loop oscillation. Classify all codimension-1 point-point 
hysteresis loops. 


(Point-point bursting) In Fig.9.61 we present two geometrical examples of point- 
point bursters that have no limit cycle attractors, yet are capable of exhibiting 
spike like dynamics in the active phase. Construct a model for each type of 
point-point burster in the figure. Use phase portrait snapshots at the bottom of 
the figure as hints. What makes such bursting possible? 
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Figure 9.61: Two examples of point-point (not fast-slow) bursters. (Modified from 
Izhikevich 2000a.) 


Figure 9.62: A cycle-cycle bursting: 
The resting state is not an equilibrium, 
but a small-amplitude limit cycle at- 
tractor. 


21. (Cycle-cycle bursters) Consider a fast-slow burster (9.1) and suppose that the 
resting state is not an equilibrium, but a limit cycle attractor, as in Fig.9.62. 
Such a bursting is called cycle-cycle. Classify all codimension-1 planar cycle- 
cycle fast-slow bursters. Is bursting in Fig.9.10 of the cycle-cycle type? 


22. (Minimal models for bursting) Fill in the blank squares in Fig.9.8. 


23. Choose a minimal model from Fig.9.8 and simulate it. Change the parameters 
to get as many different bursting types as possible. 


24. [M.S.] Determine the bifurcation diagram of the canonical model for “fold/homoclinic” 
bursting (9.7). 


25. [M.S.] Determine the bifurcation diagrams of the canonical models for “cir- 
cle/circle” bursters (9.9) and (9.10). 
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Figure 9.63: Some canonical models of fast-slow bursters; see exercise 26. 


[Ph.D.] Consider fast-slow bursters of the form (9.1) and assume that the fast 
subsystem is near a bifurcation of high codimension, as in Fig.9.28 or in Fig.9.42. 
Treating the bifurcation point as an organizing center for the fast subsystem 
(Bertram et al. 1995; Izhikevich 2000a; Golubitsky et al. 2001), use unfolding 
theory to derive canonical models for the remaining fast-slow bursters in Fig.9.63. 
Do not assume that the slow subsystem has an autonomous oscillation or that 
the fast oscillations have small amplitude. 


[Ph.D.] Classify all possible mechanisms of emergence of bursting oscillations 
from resting or spiking, as in Fig.9.19. 


[Ph.D.] Develop an asymptotic theory of singularly perturbed systems of the 


form 
c= feu) (fast subsystem), 


uu = jog(z,u) (slow modulation) 


that can deal with transitions between equilibria and limit cycle attractors of the 
fast subsystem. 


Chapter 10 


Synchronization 


In this chapter! we consider networks of tonically spiking neurons. Like any other kind 
of physical, chemical, or biological oscillators, such neurons can synchronize and exhibit 
collective behavior that is not intrinsic to any individual neuron. For example, partial 
synchrony in cortical networks is believed to generate various brain oscillations, such as 
the alpha and gamma EEG rhythms. Increased synchrony may result in pathological 
types of activity, such as epilepsy. Coordinated synchrony is needed for locomotion and 
swim pattern generation in fish. There is an ongoing debate on the role of synchrony 
in neural computation, see e.g., the special issue of Neuron (September 1999) devoted 
to the binding problem. 

Depending on the circumstances, synchrony can be good or bad, and it is important 
to know what factors contribute to synchrony and how to control it. This is the subject 
of the present chapter — the most advanced chapter of the book. It provides a nice 
application of the theory developed earlier and hopefully gives some insight into why 
the previous chapters may be worth mastering. 

Our goal is to understand how the behavior of two coupled neurons depends on their 
intrinsic dynamics. First, we introduce the method of description of an oscillation by 
its phase. Then, we describe various methods of reduction of coupled oscillators to 
simple phase models. The reduction method and the exact form of the phase model 
depend on the type of coupling (i.e., whether it is pulsed, weak, or slow) and on the 
type of bifurcation of the limit cycle attractor generating tonic spiking. Finally, we 
show how to use phase models to understand the collective dynamics of many coupled 
oscillators. 


10.1 Pulsed Coupling 


In this section we consider oscillators of the form 


é = f(v) + Ad(t—t,), 2 eER™, (10.1) 


'The first two editions of the book had this chapter available only in electronic form on the author’s 
website www.izhikevich.com. 
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Figure 10.1: Definition of a phase of oscillation, 7, in the Iy, + [x-model with param- 
eters as in Fig.4.la and J = 10. 


having exponentially stable limit cycles and experiencing pulsed stimulation at times 
t, that instantaneously increases the state variable by the constant A. The Dirac 
delta function 6(t) is a mathematical shorthand notation for resetting « by A. The 
strength of pulsed stimulation, A, is not assumed to be small. Most of the results of 
this section can also be applied to the case in which the action of the input pulse is not 
instantaneous, but smeared over an interval of time, typically shorter than the period 
of oscillation. 


10.1.1 Phase of Oscillation 


Many types of physical, chemical, and biological oscillators share an astonishing feature: 
they can be described by a single phase variable 7. In the context of tonic spiking, the 
phase is usually taken to be the time since the last spike, as in Fig.10.1a. 

We say that a function x(t) is periodic if there is a constant T’ > 0 such that 
x(t+ 7) = x(t) for any t. The minimal value of the constant is the period of x(t). 
Periodic functions appear in dynamical systems having limit cycle attractors. 

The notion of the phase of oscillation is related to the notion of parametrization 
of a limit cycle attractor, as in Fig.10.1b. Take a point x9 on the attractor and plot 
the trajectory x(t) with «(0) = zo. Then the phase of x(t) is 0 = t. As t increases 
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past the period T’, then 27’, an so on, the phase variable 7? wraps around the interval 
(0, 7], jumping from T to 0; see Fig.10.1c. Gluing together the points 0 and 7’, as in 
Fig.10.1d, we can treat the interval [0,7] as a circle, denoted as S', with circumference 
T. The parametrization is the mapping of S! in Fig.10.1d into the phase space R? in 
Fig.10.1b, given by J++ x(v). 

We could put the initial point x9 corresponding to the zero phase anywhere else on 
the limit cycle, and not necessarily at the peak of the spike. The choice of the initial 
point introduces an ambiguity in parameterizing the phase of oscillation. Different 
parametrizations, however, are equivalent up to a constant phase shift (i.e., translation 
in time). In the rest of the chapter, 7 always denotes the phase of oscillation, the 
parameter 7’ denotes the period of oscillation, and 70 = 0 corresponds to the peak of 
the spike unless stated otherwise. If the system has two or more coexisting limit cycle 
attractors, then a separate phase variable needs to be defined for each attractor. 


10.1.2 Isochrons 


The phase of oscillation can also be introduced outside the limit cycle. Consider, for 
example, point yo in Fig.10.2 (top). Since the trajectory y(t) is not on a limit cycle, 
it is not periodic. However, it approaches the cycle as t + +oo. Hence, there is some 
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point xp on the limit cycle, not necessarily the closest to yo, such that 
y(t) > a(t) as t>+00. (10.2) 


Now take the phase of the nonperiodic solution y(t) to be the phase of its periodic 
proxy x(t). 

Alternatively, we can consider a point on the limit cycle xp and find all the other 
points yo that satisfy (10.2). The set of all such points is called the stable manifold 
of x. Since any solution starting on the stable manifold has an asymptotic behavior 
indistinguishable from that of x(t), its phase is the same as that of x(t). For this 
reason, the manifold represents solutions having equal phases, and it is often referred 
to as being the isochron of x9 (iso, equal; chronos, time, in Greek), a notion going back 
to Bernoulli and Leibniz. 

Every point on the plane in Fig.10.2, except the unstable equilibrium, gives rise to 
a trajectory that approaches the limit cycle. Therefore, every point has some phase. 
Let v(x) denote the phase of the point x. Then, isochrons are level contours of the 
function U(x), since the function is constant on each isochron. 

The entire plane is foliated by isochrons. We depict only 40 representative ones 
in Fig.10.2. In this chapter we consider neighborhoods of exponentially stable limit 
cycles, where the foliation is continuous and invariant (Guckenheimer 1975): 


e Continuity. The function V(x) is continuous so that nearby points have nearby 
phases. 


e Invariance. If ¥(x(0)) = V(y(0)), then Y(a(t)) = Y(y(t)) for all t. Isochrons are 
mapped to isochrons by the flow of the vector field. 


Fig.10.3 shows the geometry of isochrons of various oscillators. The Andronov-Hopf 
oscillator in the figure is often called a radial isochron clock for the obvious reason. It 
is simple enough to be solved explicitly (see exercise 1). In general, finding isochrons 
is a daunting mathematical task. In exercise 3 we present a MATLAB program that 
finds isochrons numerically. 


10.1.3 PRC 


Consider a periodically spiking neuron (10.1) receiving a single brief pulse of current 
that increases the membrane potential by A = 1 mV, as in Fig.10.4 (left). Such a 
perturbation may not elicit an immediate spike, but it can change the timing, that is, 
the phase, of the following spikes. For example, the perturbed trajectory (solid line in 
Fig.10.4, left) fires earlier than the free-running unperturbed trajectory (dashed line). 
That is, right after the perturbation, the phase, Vpew, is greater than the old phase, 
v. The magnitude of the phase shift of the spike train depends on the exact timing of 
the stimulus relative to the phase of oscillation 7. Stimulating the neuron at different 
phases, we can measure the phase response curve (also called phase-resetting curve 
PRC, or spike time response curve STRC) 


PROV) = {0p = 0} (shift = new phase — old phase) , 
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Figure 10.3: Isochrons of various oscillators. Andronov-Hopf oscillator: 2 = (1 + i)z — 
2z\z|?, z © C. van der Pol oscillator: ¢ =x —23?-—y, y=2x. The Iya + Ix-model with 
parameters as in Fig.4.la and J = 10 (Class 1) and J = 35 (Class 2). Only isochrons 
corresponding to phases nT'/20, n = 1,...,20, are shown. 


depicted in Fig.10.4, right. Positive (negative) values of the function correspond to 
phase advances (delays) in the sense that they advance (delay) the timing of the next 
spike. 

In contrast to the common folklore, the function PRC (v7) can be measured for an 
arbitrary stimulus, not necessarily weak or brief. The only caveat is that to measure 
the new phase of oscillation perturbed by a stimulus, we must wait long enough for 
transients to subside. This becomes a limiting factor when PRCs are used to study 
synchronization of oscillators to periodic pulses, as we do in section 10.1.5. 

There is a simple geometrical relationship between the structure of isochrons of an 
oscillator and its PRC, illustrated in Fig.10.5 (see also exercise 6). Let us stimulate 
the oscillator at phase V with a pulse, which moves the trajectory from point x lying 
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Figure 10.4: Phase response of the Jy, + Jx-model with parameters as in Fig.4.la and 
I =4.7. The dashed voltage trace is the free-running trajectory. 


on the intersection of isochron 7 and the limit cycle attractor to a point y lying on 
some isochron Upew. From the definition of PRC, it follows that Upew = J+PRC (Vv). 

In general, one uses simulations to determine PRCs, as we do in Fig.10.4. Using 
the MATLAB program presented in exercise 5, we can determine PRCs of all four 
oscillators in Fig.10.3 and plot them in Fig.10.6. It is a good exercise to explain the 
shape of each PRC in the figure, or at least its sign, using the geometry of isochrons 
of corresponding oscillators. In section 10.2.4 we discuss pitfalls of using the straight- 
forward method in Fig.10.4 to measure PRCs in biological neurons, and we present a 
better technique. 

Note that the PRC of the Jy, + Ix-model in Fig.10.6 is mainly positive in the 
Class 1 regime, that is, when the oscillations appear via saddle-node on invariant circle 
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Figure 10.5: The geometrical relationship between isochrons and the phase response 
curve (PRC) of the Jy, + J,-oscillator in Fig.10.1. 
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Figure 10.6: Examples of phase response curves (PRC) of the oscillators in Fig.10.3. 
PRC,(vV): Horizontal pulses (along the first variable) with amplitudes 0.2, 0.2, 2, 0.2 for 
Andnronov-Hopf, van der Pol, Class 1 and Class 2 oscillators, respectively. PRC2(v): 
Vertical pulses (along the second variable) with amplitudes 0.2, 0.2, 0.02, 0.002, respec- 
tively. An example of oscillation is plotted as a dotted curve in each subplot (not to 
scale). 


bifurcation, but changes sign in the Class 2 regime, corresponding in this case to the 
supercritical Andronov-Hopf bifurcation. In section 10.4 we find PRCs analytically 
in the case of weak coupling, and show that the PRC of a Class 1 oscillator has the 
shape sin? J (period T = 7) or 1 — cos¥ (period T = 27), whereas that of a Class 
2 oscillator has the shape sin¥v (period T = 27). We show in section 10.1.7 how the 
synchronization properties of an oscillator depend on the shape of its PRC. 


10.1.4 Type 0 and Type 1 Phase Response 


Instead of phase-resetting curves, many researchers in the field of circadian rhythms 
consider phase transition curves (Winfree 1980) 


Ves = PTC (Vola) 


Since 


PTC (8) = {9 + PRC (9)} mod T, 
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Figure 10.7: Types of phase-resetting of the Andronov-Hopf oscillator in Fig.10.3. 


the two approaches are equivalent. PRCs are convenient when the phase shifts are 
small, so that they can be magnified and seen clearly. PTCs are convenient when the 
phase shifts are large and comparable with the period of oscillation. We present PT'Cs 
in this section solely for the sake of review, and we use PRCs throughout the rest of 
the chapter. 

In Fig.10.7 (top) we depict phase portraits of the Andronov-Hopf oscillator having 
radial isochrons and receiving pulses of magnitude A = 0.5 (left) and A = 1.5 (right). 
Note the drastic difference between the corresponding PRCs or PTCs. Winfree (1980) 
distinguishes two cases: 


e Type 1 (weak) resetting results in continuous PRCs and PTCs with mean slope 
1. 


e Type 0 (strong) resetting results in discontinuous PRCs and PTCs with mean 
slope 0. 
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Figure 10.8: Time crystal (left) and its contour plot (right). Shown is the PTC (V, A) 
of the Andronoy-Hopf oscillator (see exercise 4). 
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(Do not confuse these classes with Class 1, 2, or 3 excitability.) The discontinuity 
of the Type 0 PRC in Fig.10.7 is a topological property that cannot be removed by 
reallocating the initial point x) that corresponds to zero phase. As an exercise, prove 
that the discontinuity stems from the fact that the shifted image of the limit cycle 
(dashed circle) goes beyond the central equilibrium at which the phase is not defined. 


If we vary not only the phase v7 of the applied stimulus, but also its amplitude 
A, then we obtain parameterized PRC and PTC. In Fig.10.8 we plot PTC (VJ, A) of 
the Andronov-Hopf oscillator (the corresponding PRC is derived in exercise 4). The 
surface is called time crystal and it can take quite amazing shapes (Winfree 1980). The 
contour plot of PTC (VJ, A) in the figure contains the singularity point (black hole) that 
corresponds to the phaseless equilibrium of the Andronov-Hopf oscillator. Stimulation 
at phase 0 = a with magnitude A = 1 pushes the trajectory into the equilibrium and 
stalls the oscillation. 
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Figure 10.10: Description of synchronization of Jy, + [,-oscillator in Fig.10.4, using 
Poincare phase map. 


10.1.5 Poincare Phase Map 


The phase-resetting curve (PRC) describes the response of an oscillator to a single 
pulse, but it can also be used to study its response to a periodic pulse train using the 
following “stroboscopic” approach. Let Vv, denote the phase of oscillation at the time 
the nth input pulse arrives. Such a pulse resets the phase by PRC (v,,), so that the new 
phase right after the pulse is J,+PRC (V,,) (see Fig.10.9). Let T, denote the period of 
pulsed stimulation. Then the phase of oscillation before the next, (n + 1)th, pulse is 
Un+PRC (V,) + Ts. Thus, we have a stroboscopic mapping of a circle to itself, 


Ons = (Vn + PRC (V,) + T;) mod T, (10.3) 


called the Poincare phase map (two pulse-coupled oscillators are considered in exer- 
cise 11). Knowing the initial phase of oscillation v; at the first pulse, we can determine 
V2, then V3, and so on. The sequence {¥,,} with n = 1,2,..., is called the orbit of the 
map, and it is quite easy to find numerically. 

Let us illustrate this concept using the Jy, + J,-oscillator with PRC shown in 
Fig.10.4. Its free-running period is T’ * 21.37 ms, and the period of stimulation 
in Fig.10.10a is 7, = 18.37, which results in the Poincare phase map depicted in 
Fig.10.10d. The cobweb in the figure is the orbit going from V7; to J. to V3, and so 
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on. Note that the phase 73 cannot be measured directly from the voltage trace in 
Fig.10.10a because pulse 2 changes the phase, so it is not the time since the last spike 
when pulse 3 arrives. The Poincare phase map (10.3) takes into account such multiple 
pulses. The orbit approaches a point (called a fixed point; see below) that corresponds 
to a synchronized or phase-locked state. 

A word of caution is in order. Recall that PRCs are measured on the limit cycle 
attractor. However, each pulse displaces the trajectory away from the attractor, as 
in Fig.10.5. To use the PRC formalism to describe the effect of the next pulse, the 
oscillator must be given enough time to relax back to the limit cycle attractor. Thus, 
if the period of stimulation JT, is too small, or the attraction to the limit cycle is too 
slow, or the stimulus amplitude is too large, the Poincare phase map may be not an 
appropriate tool to describe the phase dynamics. 


10.1.6 Fixed points 


To understand the structure of orbits of the Poincare phase map (10.3), or any other 
map 


Ontt = F (Pn) ’ (10.4) 


we need to find its fixed points 
v= 70) (J is a fixed point), 


which are analogues of equilibria of continuous dynamical systems. Geometrically, a 
fixed point is the intersection of the graph of f(v) with the diagonal line Jp41 = Vpn 
(see Fig.10.10d or Fig.10.11). At such a point, the orbit Jni1 = f(Un) = Vn is fixed. 
A fixed point v is asymptotically stable if it attracts all nearby orbits, i.e., if 7, is in 
a sufficiently small neighborhood of v7, then J, > J as n > ow, as in Fig.10.11, left. 
The fixed point is unstable if any small neighborhood of the point contains an orbit 
diverging from it, as in Fig.10.11 (right). 
The stability of the fixed point is determined by the slope 


m= fd) 


of the graph of f at the point, which is called the Floquet multiplier of the mapping. 
It plays the same role as the eigenvalue of an equilibrium of a continuous dynamical 
system. Mnemonically, the relationship between them is js = e*, to which the fixed 
point is stable when |m| < 1 (A < 0) and unstable when |m| > 1 (A > 0). Fixed 
points bifurcate when |m| = 1 (A is zero or purely imaginary). They lose stability 
via flip bifurcation (a discrete analogue of Andronov-Hopf bifurcation) when m = —1 
and disappear via fold bifurcation (a discrete analogue of saddle-node bifurcation) 
when m = 1. The former plays an important role in the period-doubling phenomenon 
illustrated in Fig.10.14 (bottom trace). The latter plays an important role in the 
cycle-slipping phenomenon illustrated in Fig.10.16. 
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Figure 10.11: The stability of fixed points of the mapping (10.4) depends on the slope 
of the function f. 


10.1.7 Synchronization 


We say that two periodic pulse trains are synchronous when the pulses occur at the 
same time or with a constant phase shift, as in Fig.10.12a. Each subplot in the figure 
contains an input pulse train (bottom) and an output spike train (top), assuming 
that spikes are fired at zero crossings of the phase variable, as in Fig.10.1. Such 
a synchronized state corresponds to a stable fixed point of the Poincare phase map 
(10.3). The in-phase, anti-phase, or out-of-phase synchronization corresponds to the 
phase shift 0 = 0, J) = T/2, or some other value, respectively. Many scientists refer 
to the in-phase synchronization simply as “synchronization”, and use the adjectives 
anti-phase and out-of-phase to denote the other types of synchronization. 

When the period of stimulation, T;, is near the free-running period of tonic spiking, 
T, the fixed point of (10.3) satisfies 


PRC (3) =T —T,, 


that is, it is the intersection of the PRC and the horizontal line, as in Fig.10.13. Thus, 
synchronization occurs with a phase shift 7? that compensates for the input period 
mismatch 7 — T,. The maxima and the minima of the PRC determine the oscillator’s 
tolerance of the mismatch. As an exercise, check that stable fixed points lie on the side 
of the graph with the slope 


—2 < PRC'(¥) <0 (stability region) 
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Figure 10.12: Examples of fundamental types of synchronization of spiking activity to 
periodic pulsed inputs (synchronization is 1:1 phase-locking). 


unstable _..-- stability 
Mo region 
4%, 
stable : ” 
phase ‘ stability : 
shift Nason -. 
- Figure 10.13: Fixed points of the Poincare 
stimulus phase, 0 T phase map (10.3). 


marked by the bold curves in Fig.10.13. 

Now consider the Class 1 and Class 2 Iy, + [,-oscillators shown in Fig.10.6. The 
PRC in the Class 1 regime is mostly positive, implying that such an oscillator can 
easily synchronize with faster inputs (7’— T, > 0) but cannot synchronize with slower 
inputs. Indeed, the oscillator can advance its phase to catch up with faster pulse trains, 
but it cannot delay the phase to wait for the slower input. Synchronization with the 
input having 7, + T is only marginal. In contrast, the Class 2 Iy, + I,-oscillator does 
not have this problem because its PRC has well-defined positive and negative regions. 


10.1.8 Phase-Locking 


The phenomenon of p:q-phase-locking occurs when the oscillator fires p spikes for every 
q input pulses, such as the 3:2-phase-locking in Fig.10.12b or the 2:2 phase-locking in 
Fig.10.14, which typically occurs when pT’ = qT. The integers p and q need not be 
relatively prime in the case of pulsed-coupled oscillators. Synchronization, that is, 1:1 
phase-locking, as well as p:1 phase-locking corresponds to a fixed point of the Poincare 
phase map (10.3) with p fired spikes per single input pulse. Indeed, the map tells the 
phase of the oscillator at each pulse, but not the number of oscillations between the 
pulses. 

Each p:q-locked solution corresponds to a stable periodic orbit of the Poincare 
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Figure 10.14: Coexistence of synchronized and phase-locked solutions corresponds to 
coexistence of a stable fixed point and a stable periodic orbit of the Poincare phase 
map. 


phase map with the period q (so that J; = Vn+q for any n). Such orbits in maps (10.4) 
correspond to stable equilibria in the iterates 0,41 = f4(V;,), where f? = fofo---of 
is the composition of f with itself q times. Geometrically, studying such maps is like 
considering every gth input pulse in Fig.10.12b and ignoring all the intermediate pulses. 
Since maps can have coexistence of stable fixed points and periodic orbits, various 
synchronized and phase-locking states can coexist in response to the same input pulse 
train, as in Fig.10.14. The oscillator converges to one of the states, depending on the 
initial phase of oscillation, but can be switched between states by a transient input. 


10.1.9 Arnold Tongues 


To synchronize an oscillator, the input pulse train must have a period J; sufficiently 
near the oscillator’s free-running period T' so that the graph of the PRC and the hori- 
zontal line in Fig.10.13 intersect. The amplitude of the function |PRC (v, A)| decreases 
as the strength of the pulse A decreases, because weaker pulses produce weaker phase 
shifts. Hence the region of existence of a synchronized state shrinks as A —> 0, and it 
looks like a horn or a tongue on the (Jj, A)-plane depicted in Fig.10.15, called Arnold 
tongue. Each p:q-phase-locked state has its own region of existence (p:q-tongue in the 
figure), which also shrinks to a point pT’/q on the T;-axis. The larger the order of 
locking, p+ q, the narrower the tongue and the more difficult it is to observe such a 
phase-locked state numerically, let alone experimentally. 

The tongues can overlap, leading to the coexistence of phase-locked states, as in 
Fig.10.14. If A is sufficiently large, the Poincare phase map (10.3) becomes nonin- 
vertible, that is, it has a region of negative slope, and there is a possibility of chaotic 
dynamics (Glass and Mackey 1988). 

In Fig.10.16 we illustrate the cycle slipping phenomenon that occurs when the input 
period T, drifts away from the 1:1 Arnold tongue. The fixed point of the Poincare 
phase map corresponding to the synchronized state undergoes a fold bifurcation and 
disappears. In a way similar to the case of saddle-node on invariant circle bifurcation, 
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Figure 10.15: Arnold tongues are regions of existence of various phase-locked states on 
the “period-strength” plane. 
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Figure 10.16: Cycle slipping phenomenon at the edge of the Arnold tongue correspond- 
ing to a synchronized state. 


the fold fixed point becomes a ghost attractor that traps orbits and keeps them near 
the synchronized state for a long period of time. Eventually the orbit escapes, the 
synchronized state is briefly lost, and then the orbit returns to the ghost attractor to 
be trapped again. Such an intermittently synchronized orbit typically corresponds to 
a p:q-phase-locked state with a high order of locking p+ q. 


10.2 Weak Coupling 


In this section we consider dynamical systems of the form 
& = f(x) + eplt) , (10.5) 


describing periodic oscillators, ¢ = f(x), forced by a time-depended input ep(t), for 
instance, from other oscillators in a network. The positive parameter ¢ measures the 
overall strength of the input, and it is assumed to be sufficiently small, denoted as 
€ <1. We do not assume ¢ — 0 here. In fact, most of the results in this section can 
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Figure 10.17: Arthur Winfree in 2001. 
(Photo provided by Martin Homer, 
University of Bristol.) 


oP) 


be cast in the form “there is an €) such that for all ¢ < €9, the following holds. . . 
(Hoppensteadt and Izhikevich 1997), with ¢) depending on the function f(a) in (10.5) 
and sometimes taking not so small values, such as, €9 = 1. 

Note that if ¢ = 0 in (10.5), we can transform # = f(x), to ) = 1 using the theory 
presented in section 10.1. What happens when we apply the same transformation to 
(10.5) with « 4 0? In this section we present three different but equivalent approaches 
that transform (10.5) into the phase model 


8) =1+ePRC()p(t) + o(e) . 
Here, Landau’s “little oh” function o(¢) denotes the error terms smaller than < so that 
o(e)/e + 0 if e > 0. For the sake of clarity of notation, we omit o(¢) throughout the 
book, and implicitly assume that all equalities are valid up to the terms of order o(¢). 
Since we do not impose restrictions on the form of p(t), the three methods are 
readily applicable to the case 


p(t) = S> gs(a(t),26(t)) , 


where the set {x,(t)} denotes oscillators in the network connected to x, and p(t) is the 
postsynaptic current. 


10.2.1 Winfree’s Approach 


A sufficiently small neighborhood of the limit cycle attractor of the unperturbed 
(¢ = 0) oscillator (10.5), magnified in Fig.10.18, has nearly collinear uniformly spaced 
isochrons. Collinearity implies that a point x on the limit cycle in Fig.10.18 has the 
same phase-resetting as any other point y on the isochron of x near the cycle. Uniform 
density of isochrons implies that the phase-resetting scales linearly with the strength 
of the pulse, that is, a half-pulse at point z in Fig.10.18 produces a half-resetting of 
the phase. 

Linear scaling of PRC with respect to the strength of the pulse motivates the 
substitution 

PRC (0, A) & Z(V)A, 
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Figure 10.18: Magnification of isochrons in a small neighborhood of the limit cycle of 
the Iya + Ix-model in Fig.10.3. Isochron time step: 0.025 ms on the left, 0.35 ms on 
the right. 
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Figure 10.19: A continuous function p(t) is replaced by an equivalent train of pulses of 
variable amplitudes. 


where Z(V) = OPRC(W, A)/OA at A =0 is the linear response or sensitivity function 
(Winfree 1967) describing the slight alteration of rate, or of instantaneous frequency of 
oscillation, accompanying application of a small stimulus. Some call it the infinitesimal 
PRG. 

Now suppose ¢ ¥ 0 but is sufficiently small that the trajectory of the weakly per- 
turbed oscillator (10.5) remains near the limit cycle attractor all the time. Let us re- 
place the continuous input function ep(t) with the equivalent train of pulses of strength 
A = ep(t,)h, where h is a small interpulse interval (denoted as T; in section 10.1), and 
t, = nh is the timing of the nth pulse, see Fig.10.19. We rewrite the corresponding 
Poincare phase map (10.3) 


PRC 
O(tns1) = {0 (tn) + Z((tn)) ep(t, )h+h} mod T 
A 
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Figure 10.20: Yoshiki Kuramoto in 
1988, while he was visiting Jim Mur- 
ray’s institute at Oxford University. 
(Picture provided by Dr. Y. Ku- 
ramoto. ) 


in the form 
U(ty +h) — Vtn) 
h 


which is a discrete version of 


§=1+eZ(¥) - p(t), (10.6) 


in the limit h > 0. 

To be consistent with all the examples in section 10.1, we implicitly assume here 
that p(t) perturbs only the first, voltage-like variable x, of the state vector x = 
(@1,...,U%m) € R™ and that Z(v) is the corresponding sensitivity function. However, 
the phase model (10.6) is also valid for an arbitrary input p(t) = (pi(t),...,DPm(t)). 
Indeed, let Z; describe the linear response to perturbations of the ith state variable 
xj, and Z(V) = (Z,(V),..., Zm(V)) denote the corresponding linear response vector- 
function. Then the combined phase shift Z,p; +---+ Zmpm is the dot product Z-p in 
(10.6). 


10.2.2 Kuramoto’s Approach 


Consider the unperturbed (¢ = 0) oscillator (10.5), and let the function (a) denote 
the phases of points near its limit cycle attractor. Obviously, isochrons are the level 
contours of W(x) since the function is constant on each isochron. Differentiating the 
function using the chain rule yields 


dv(x) dx 
AC grad v - 7 grad vd - f(x) , 


where grad¥ = (Uz,(2),...,0xz,,(@)) is the gradient of V(a) with respect to the state 
vector © = (%1,...,%m) € R™. However, 


d(x) 


=! 
dt 
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Figure 10.21: Geometrical interpretation 
of the vector grad VJ. 


Figure 10.22: Ioel Gil’evich Malkin (Moamp 
Tunpesuy Maskun, 1907-1958). 


near the limit cycle because isochrons are mapped to isochrons by the flow of the vector 
field f(x). Therefore, we obtain a useful equality, 


ptad f(a) = 1. (10.7) 


Figure 10.21 shows a geometrical interpretation of grad V(x): it is the vector based at 
point x, normal to the isochron of x and with a length equal to the number density of 
isochrons at x. Its length can also be found from (10.7). 

Kuramoto (1984) applied the chain rule to the perturbed system (10.5), 


wie) “ = grad J - { f(x) + ep(t)} = grad v - f(x) + egradd - pit) , 


and, using (10.7), obtained the phase model 


= grad? - 


0 =1+egradv - p(t) , (10.8) 


which has the same form as (10.6). Subtracting (10.8) from (10.6) yields (Z(v) — 
grad?) - p(t) = 0. Since this is valid for any p(t), we conclude that Z(v) = gradvd 
(see also exercise 6). Thus, Kuramoto’s phase model (10.8) is indeed equivalent to 
Winfree’s model (10.8). 


10.2.3. Malkin’s Approach 


Yet another equivalent method of reduction of weakly perturbed oscillators to their 
phase models follows from Malkin’s theorem (1949, 1956), which we state in the sim- 
plest form below. The most abstract form and its proof are provided by Hoppensteadt 
and Izhikevich (1997). 
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Figure 10.23: Solutions Q = (Qi,Q2) to adjoint problem (10.10) for oscillators in 
Fig.10.3. 


Malkin’s theorem. Suppose the unperturbed (¢ = 0) oscillator in (10.5) has an 
exponentially stable limit cycle of period T. Then its phase is described by the equation 


0=1+eQ(0) - p(t), (10.9) 
where the T-periodic function Q is the solution to the linear “adjoint” equation 


Q=-{Df(e)}™@, — with Q(0)- fe) = 1, (10.10) 


where Df(a(t))' is the transposed Jacobian of f (matrix of partial derivatives) at 
the point x(t) on the limit cycle, and the normalization condition can be replaced by 
Q(t)- f(x(t)) = 1 for any, and hence all, t. Here Q- f is the dot product of two vectors, 
which is the same as Q' f. 

Though this theorem looks less intuitive than the methods of Winfree and Ku- 
ramoto, it is actually more useful because (10.10) can be solved numerically quite eas- 
ily. Applying the MATLAB procedure in exercise 12 to the four oscillators in Fig.10.3, 
we plot their functions Q in Fig.10.23. It is not a coincidence that each component of Q 
looks like PRC along the first or second state variable, shown in Fig.10.6. Subtracting 
(10.9) from (10.8) or from (10.6), we conclude that 


Z(0) = grad 0(x) = Q(Y) , 


(see also exercise 7), so that we can determine the linear response function of the phase 
model using any of the three alternative methods: via PRCs, via isochrons, or solving 
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the adjoint equation (10.10). This justifies the reason why many refer to the function 
simply as PRC, implicitly assuming that it is measured to the infinitesimal stimuli and 
then normalized by the stimulus amplitude. 


10.2.4 Measuring PRCs Experimentally 


In Fig.10.24 we exploit the relationship (10.9) and measure the infinitesimal PRCs of a 
layer 5 pyramidal neuron of mouse visual cortex. First, we stimulate the neuron with 
40 pA DC current to elicit periodic spiking. Initially, the firing period starts at 50 ms, 
and then relaxes to the averaged value of 110 ms (Fig.10.24a). The standard method of 
finding PRCs consists in stimulating the neuron with brief pulses of current at different 
phases of the cycle and measuring the induced phase shift, which can be approximated 
by the difference between two successive periods of oscillation. The method works well 
in models (see exercise 5), but should be used with caution in real neurons because 
their firing is too noisy, as we demonstrate in Fig.10.24b. Thus, one needs to apply 
hundreds, if not thousands, of pulses and then average the resulting phase deviations 
(Reyes and Fetz 1993). 

Starting with time 10 sec, we inject a relatively weak noisy current ep(t) that 
continuously perturbs the membrane potential (Fig.10.24c) and, hence, the phase of 
oscillation (the choice of p(t) is important; its Fourier spectrum must span a range of 
frequencies that depends on the frequency of firing of the neuron). Knowing ep(t), the 
moments of firing of the neuron, which are zero crossings V(t) = 0, and the relationship 


§ =14+PRC(d)ep(t) , 


we solve the inverse problem for the infinitesimal PRC (wv) and plot the solution in 
Fig.10.24d. As one expects, the PRC is mostly positive, maximal just before the spike 
and almost zero during the spike. It would resemble the PRC in Fig.10.23 (Q,(V) in 
Class 1) if not for the dip in the middle, for which we have no explanation (probably it 
is due to overfitting). The advantage of this method is that it is more immune to noise, 
because intrinsic fluctuations are spread over the entire p(t) and not concentrated at 
the moments of pulses — unless, of course p(t), consists of random pulses, in which case 
this method is equivalent to the standard one. The drawback is that we need to solve 
the equation above, which we do in exercise 13, using an optimization technique. 


10.2.5 Phase Model for Coupled Oscillators 


Now consider n weakly coupled oscillators of the form 


pi(t) 


fee) Gatun): “tee Rk”, (10.11) 


j=l 
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Figure 10.24: Measuring the infinitesimal PRC experimentally in a layer 5 pyramidal 
neuron of mouse visual cortex. (a) Interspike periods in response to the injection of DC 
current. (b) Differences between successive periods. (c) Spiking 1 second before and 
after the noisy current p(t) is injected. (d) Infinitesimal PRC of the neuron (continuous 
curve) obtained from 40 cycles and the MATLAB program in exercise 13 (first eight 
Fourier terms). Averaged voltage trace during the spike (dotted curve) is plotted for 
reference. The same procedure is applied to (e) the Andronoyv-Hopf oscillator and (f) 
the [Na p+J«-model. Numbers in boxes represent the number of Fourier terms used to 
fit the curve; theoretical curves (functions Q)(7) from Fig.10.23) are dashed. 
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Figure 10.25: The relationship between membrane potential oscillation of two neurons, 
V, (solid) and V; (dashed), their phases, phase deviations, and phase difference. Shown 
are simulation of two Iy, + Jk-models with parameters as in Fig.10.3 and coupled 
symmetrically via gap junctions 0.1(V; — V;) (see section 2.3.4). 


and assume that the oscillators, when uncoupled (¢ = 0), have equal free-running 
periods 7, = --- = T;,, = T. Applying any of the three methods above to such a weakly 
perturbed system, we obtain the corresponding phase model 


pi(t) 


where each 2;(U;) is the point on the limit cycle having phase J;. Note that (10.11) is 
defined in R””, whereas the phase model (10.12) is defined on the n-torus, denoted as 
TM. 

To study collective properties of the network, such as synchronization, it is conve- 
nient to represent each 1;(t) as 


with the first term capturing the fast free-running natural oscillation J; = 1, and the 
second term capturing the slow network-induced build-up of phase deviation from the 
natural oscillation. The relationship between x;(t), v;(t) and y;(t) is illustrated in 
Fig.10.25. 

Substituting (10.13) into (10.12) results in 


n 


Oi =EQilt + va) d- gig (wilt + vi), g(t + 9) . (10.14) 


j=l 
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Note that the right-hand side is of order ¢, reflecting the slow dynamics of phase devia- 

tions y; seen in Fig.10.25. Thus, it contains two time scales: fast oscillations (variable 
t) and slow phase modulation (variables vy). The classical method of averaging, re- 
viewed by Hoppensteadt and Izhikevich (1997, Chap. 9), consists in a near-identity 
change of variables that transforms the system into the form 


Ge = ews ted” Hij(p; — vi) , (10.15) 
j#i 
where 
1 T 
Hyles—e) =p f QW) oulelt)et+e-ed)d, (10.16) 


and each w; = Aii(yi — yi) = Hi;(0) describes a constant frequency deviation from 
the free-running oscillation. Figure 10.26 depicts the functions Hj; corresponding to 
gap-junction (i.e., electrical; see section 2.3.4) coupling of oscillators in Fig.10.3. Prove 
that H(x) = Q(v)- A/T in the case of pulse-coupling (10.1), so that H(y) is just 
re-scaled PRC. 

A special case of (10.15) occurs when H is replaced by its first Fourier term, sin. 
The resulting system, written in the slow time T = et, 


Y; = wi + » cy sin(y; — Yi + Vis), 
j=l 


is called the Kuramoto phase model (Kuramoto 1975). Here, the frequency deviations 
w; are interpreted as intrinsic frequencies of oscillators. The strengths of connections 
cjj are often assumed to be equal to A’/n for some constant A’, so that the model can 
be studied in the limit n — oo. The phase deviations y;; are often neglected for the 
sake of simplicity. 


Figure 10.26: Solid 
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Figure 10.27: Torus knot of type (2, 3) (a) and its representation on the square (b). 
The knot produces frequency-locking and phase-locking. (c) Torus knot that does not 
produce phase-locking. 


To summarize, we transformed the weakly coupled system (10.11) into the phase 
model (10.15) with H given by (10.16) and each Q being the solution to the adjoint 
problem (10.10). This constitutes the Malkin theorem for weakly coupled oscillators 
(Hoppensteadt and Izhikevich 1997, theorem 9.2). 


10.3. Synchronization 
Consider two coupled phase variables (10.12) in a general form 


d= hy(V1,92) , 
Vo — ho(V1, V2) , 


with some positive functions h; and hg. Since each phase variable is defined on the 
circle S!, the state space of this system is the 2-torus T? = S'xS! depicted in Fig.10.27, 
with 7; and V2 being the longitude and the latitude, respectively. The torus can be 
represented as a square with vertical and horizontal sides identified, so that a solution 
disappearing at the right side of the square appears at the left side. 

The coupled oscillators above are said to be frequency-locked when there is a periodic 
trajectory on the 2-torus, which is called a torus knot. It is said to be of type (p,q) 
if J; makes p rotations while Jz makes q rotations, and p and q are relatively prime 
integers, that is, they do not have a common divisor greater than 1. Torus knots of 
type (p,q) produce p:q frequency-locking, e.g., the 2:3 frequency-locking in Fig.10.27. 
A 1:1 frequency-locking is called entrainment. There can be many periodic orbits 
on the torus, with stable orbits between unstable ones. Since the orbits on the 2- 
torus cannot intersect, they are all knots of the same type, resulting in the same p:q 
frequency-locking. 

Let us follow a trajectory on the torus and count the number of rotations of the 
phase variables. The limit of the ratio of rotations as t — oo is independent of the 
trajectory we follow, and it is called the rotation number of the torus flow. It is rational 
if and only if there is a (p,q) periodic orbit, in which case the rotation number is p/q. 
An irrational rotation number implies there are no periodic orbits, and it corresponds to 
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Figure 10.28: Various degrees of locking of oscillators. 


a quasi-periodic or multifrequency torus flow. Oscillators exhibit phase drifting in this 
case. Denjoy (1932) proved that such coupled oscillators are topologically equivalent 
to the uncoupled system 0, =r, J» = 1 with irrational r. 

Suppose the oscillators are frequency-locked; that is, there is a p:q limit cycle at- 
tractor on the torus. We say that the oscillators are p:q phase-locked if 


qvi(t) — p¥2(t) = const 


on the cycle. The value of the constant determines whether the locking is in-phase 
(const= 0), anti-phase (const= T'/2; half-period), or out-of-phase. Frequency-locking 
does not necessarily imply phase-locking: the (2,3) torus knot in Fig.10.27b corre- 
sponds to phase-locking, whereas that in Fig.10.27c does not. Frequency-locking with- 
out phase-locking is called phase trapping. Finally, synchronization is a 1:1 phase- 
locking. The phase difference J2 — v; is also called phase lag or phase lead. The 
relationships between all these definitions are shown in Fig.10.28. 

Frequency-locking, phase-locking, entrainment, and synchronization of a network 
of n > 2 oscillators are the same as pairwise locking, entrainment, and synchronization 
of the oscillators comprising the network. In addition, a network can exhibit partial 
synchronization when only a subset of oscillators is synchronized. 

Synchronization of oscillators with nearly identical frequencies is described by the 
phase model (10.15). Existence of one equilibrium of (10.15) implies the existence of 
the entire circular family of equilibria, since translation of all y; by a constant phase 
shift does not change the phase differences y; — y;, and hence the form of (10.15). 
This family corresponds to a limit cycle of (10.11), on which all oscillators, 7;(t + yi), 
have equal frequencies and constant phase shifts (i-e., they are synchronized, possibly 
out-of-phase). 


10.3.1 Two Oscillators 


Consider (10.11) with n = 2, describing two coupled oscillators, as in Fig.10.29. Let us 
introduce the “slow” time v = et and rewrite the corresponding phase model (10.15) 
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Figure 10.29: A major part of computational neuroscience concerns coupled oscillators. 


in the form 


yi, = wit Ai(y2— 1) , 
Yo = wt He(y1 — 2) , 


where ' = d/dr is the derivative with respect to slow time. Let y = y2 — yi denote 
the phase difference between the oscillators. Then the two-dimensional system above 
becomes the one-dimensional 


x =w+ G(x), (10.17) 


where 
W = W2—- Wy and G(x) = Ho(—x) — A(x) 


are the frequency mismatch and the anti-symmetric part of the coupling, respectively 
(illustrated in Fig.10.26, dashed curves). A stable equilibrium of (10.17) corresponds 
to a stable limit cycle of the phase model. 

All equilibria of (10.17) are solutions to G(yv) = —w, and they are intersections 
of the horizontal line —w with the graph of G, as illustrated in Fig.10.30a. They are 
stable if the slope of the graph is negative at the intersection. If the oscillators are 
identical, then G(y) = H(—x) — H(x) is an odd function (i.e., G(—y) = —G(x)), and 
x = 0 and xy = T/2 are always equilibria (possibly unstable) corresponding to the 
in-phase and anti-phase synchronized solutions. The stability condition of the in-phase 
synchronized state is 


G’(0) = —2H"(0) < 0 (stability of in-phase synchronization) 
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Figure 10.30: Geometrical interpretation of equilibria of the phase model (10.17) for 
gap-junction-coupled Class 2. Iya + [k-oscillators (see Fig.10.26). 
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Figure 10.31: Functions G(x) for weakly coupled oscillators of non-relaxation (smooth) 
and relaxation types. The frequency mismatch w creates a phase difference in the 
smooth case, but not in the relaxation case. 


The in-phase synchronization of electrically (gap-junction) coupled oscillators in Fig.10.26 
is stable because the slope of G' (dashed curves) is negative at y = 0. Simulation of two 
coupled Jy, + Jx-oscillators in Fig.10.25 confirms that. Coupled oscillators in the Class 
2 regime also have a stable anti-phase solution, since G’ < 0 at y = T/2 in Fig.10.30a. 


The max and min values of the function G determine the tolerance of the network 
for the frequency mismatch w, since there are no equilibria outside this range. Ge- 
ometrically, as w increases (the second oscillator speeds up), the horizontal line —w 
in Fig.10.30a slides downward, and the phase difference y = y2 — y increases, com- 
pensating for the frequency mismatch w. When w > — min G, the second oscillator 
becomes too fast, and the synchronized state is lost via saddle-node on invariant circle 
bifurcation (see Fig.10.30b). This bifurcation corresponds to the annihilation of stable 
and unstable limit cycles of the weakly coupled network, and the resulting activity is 
called drifting, cycle slipping, or phase walk-through. The variable y slowly passes 
the ghost of the saddle-node point, where G(y) ~* 0, then increases past T, appears 
at 0, and approaches the ghost again, thereby slipping a cycle and walking through 
all the phase values [0,7]. The frequency of such slipping scales as ~w + minG; see 
section 6.1.2. 


In Fig.10.31 we contrast synchronization properties of weakly coupled oscillators of 
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relaxation and non-relaxation type. The function G(x) of the former has a negative 
discontinuity at x = 0 (section 10.4.4). An immediate consequence is that the in-phase 
synchronization is rapid and persistent in the presence of the frequency mismatch 
w. Indeed, if G is smooth, then y slows down while it approaches the equilibrium 
y = 0. As a result, complete synchronization is an asymptotic process that requires 
an infinite period of time to attain. In contrast, when G is discontinuous at 0, the 
variable y does not slow down, and it takes a finite period of time to lock. Changing 
the frequency mismatch w shifts the root of —w = G(y) in the continuous case, but 
not in the discontinuous case. Hence, the in-phase synchronized state x = 0 of coupled 
relaxation oscillators exists and is stable in a wide range of w. 


10.3.2 Chains 


Understanding the synchronization properties of two coupled oscillators helps one in 
studying the dynamics of chains of n > 2 oscillators 


y=wit AT (gia - 9) + (G-1- vi), (10.18) 
where the functions Ht and H~ describe the coupling in the ascending and descending 
directions of the chain, as in Fig.10.32. Any phase-locked solution of (10.18) has the 


form y;(T) = wot + @, where wo is the common frequency of oscillation and ¢; are 
constants. These satisfy n conditions 


Wo = WT H* (2 a 1) ) 
Wo = w; + H* (dis: — 61) + H (di-1 — $4) , 1=2,....n-1, 
Wo = Wr HH (@n-1 = On) : 


A solution with ¢, < ¢2 < ++: < @n or with @; > 2 > +++ > dbp (as in Fig.10.32) 
is called a_ traveling wave. Indeed, the oscillators oscillate with a common frequency 
wo but with different phases that increase or decrease monotonically along the chain. 
Such a behavior is believed to correspond to central pattern generation (CPG) in 
crayfish, undulatory locomotion in lampreys and dogfish, and peristalsis in vascular and 
intestinal smooth muscles. Below we consider two fundamentally different mechanisms 
of generation of traveling waves. 


Frequency Differences 


Suppose the connections in (10.18) look qualitatively similar to those in Fig.10.26, in 
particular, H*(0) = H~(0) = 0. If the frequencies are all equal, then the in-phase 
synchronized solution y; =--- = Yp exists and is stable. A traveling wave exists when 
the frequencies are not all equal. 

Let us seek the conditions for the existence of a traveling wave with a constant 
phase shift, say x = ¢;41 — ¢;, along the chain. Subtracting each equation from the 
second one, we find that 


0=w2-—w,+ HH (-x), 0=we—4;, 0 = we — Wn + Ht (x), 
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Figure 10.32: Traveling wave solutions in chains of oscillators (10.18) describe undula- 
tory locomotion and central pattern generation. 


and wo = Ww, +W, —We. In particular, if wy < we = +--+ = Wp_1 < Wy, which corresponds 
to the first oscillator being tuned up and the last oscillator being tuned down, then 
xy < 0 and the traveling wave moves upward, as in Fig.10.32, that is, from the fastest to 
the slowest oscillator. Interestingly, such an ascending wave exists even when H~ = 0, 
that is, even when the coupling is only in the opposite, descending direction. 


When there is a linear gradient of frequencies (w; > wo > ++: > Wy or vice versa), 
as in the cases of the smooth muscle of intestines or leech CPG for swimming, one may 
still observe a traveling wave, but with a non-constant phase difference along the chain. 
When the gradient is large enough, the synchronized solution corresponding to a single 
traveling wave disappears, and frequency plateaus may appear (Ermentrout and Kopell 
1984). That is, solutions occur in which the first k < n oscillators are phase-locked 
and the last n — k oscillators are phase-locked as well, but the two pools, forming two 
clusters, oscillate with different frequencies. There may be many frequency plateaus. 


Coupling Functions 


A traveling wave solution may exist even when all the frequencies are equal, if either 
H*(0) 40 or H~(0) 4 0. As an example, consider the case of descending coupling 
(H~ = 0) 


From y/, = w we find that wo = w, that is, the common frequency is the frequency 
of the free oscillation of the last, uncoupled oscillator. The phase lag along the chain, 
X = Yis1 — Yi, satisfies n — 1 identical conditions 0 = H*t(y). Thus, the traveling wave 
with a constant phase shift exists when H~* has a zero crossing with positive slope, in 
contrast to Fig.10.26. The sign of y, and not the direction of coupling, determines the 
direction of wave propagation. 
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10.3.3. Networks 


Now let us consider weakly connected networks (10.11) with arbitrary, possibly all- 
to-all coupling. To study synchronized states of the network, we need to determine 
whether the corresponding phase model (10.15) has equilibria and to examine their 
stability properties. A vector @ = (@1,...,@n) is an equilibrium of (10.15) when 


0O=u;+ 3 Hi;(¢; -—¢:) for alli. (10.19) 
JA 


It is stable when all eigenvalues of the linearization matrix (Jacobian) at ¢ have nega- 
tive real parts, except one zero eigenvalue corresponding to the eigenvector along the 
circular family of equilibria (¢@ plus a phase shift is a solution of (10.19), too, since the 
phase differences ¢; — ¢; are not affected). 

In general, determining the stability of equilibria is a difficult problem. Ermentrout 
(1992) found a simple sufficient condition. Namely, if 


© ai = Hi,(¢; — ¢) = 0, and 


e the directed graph defined by the matrix a = (a;;) is connected (i.e., each oscil- 
lator is influenced, possibly indirectly, by every other oscillator), 


then the equilibrium ¢ is neutrally stable, and the corresponding limit cycle x(t + ¢) 
of (10.11) is asymptotically stable. 

Another sufficient condition was found by Hoppensteadt and Izhikevich (1997). It 
states that if system (10.15) satisfies 


ew} =-:-=w,=w (identical frequencies) and 
e H;;(—x) = —Hji(x) (pairwise odd coupling) 


for all 2 and j, then the network dynamics converge to a limit cycle. On the cycle, all 
oscillators have equal frequencies 1 + ew and constant phase deviations. 

The proof follows from the observation that (10.15) is a gradient system in the 
rotating coordinates y = wr + ¢, with the energy function 


n n 


x 
> S- Ris (¢ i) 5 where Ri (x) = i H,;(s) ds ‘ 


EET 


One can check that dE(¢)/dr = — >>(¢/)? < 0 along the trajectories of (10.15), with 
equality only at equilibria. 
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Figure 10.33: The Kuramoto synchronization in- 
dex (10.21) describes the degree of coherence in 
the network (10.20). 


10.3.4 Mean-Field Approximations 


Synchronization of the phase model (10.15) with randomly distributed frequency de- 
viations w; can be analyzed in the limit n — oo, often called the thermodynamic limit 
by physicists. We illustrate the theory using the special case H(y) = sin y (Kuramoto 
1975) 


=Wjpt 7 Me Yi) pi € [0,27] , (10.20) 


where kK > 0 is the coupling strength and the factor 1/n ensures that the model 
behaves well as n — oo. The complex-valued sum of all phases, 


fees - y eli (Kuramoto synchronization index), (10.21) 
n 


describes the degree of synchronization in the network. The parameter r is often 
called the order parameter by physicists. Apparently, the in-phase synchronized state 
(1 =-++: = %n corresponds to r = 1, with w being the population phase. In contrast, 
the incoherent state, with all y; having different values randomly distributed on the 
unit circle, corresponds to r ~ 0. (The case r & 0 can also correspond to two or more 
clusters of synchronized neurons, oscillating anti-phase or out-of-phase and canceling 
each other.) Intermediate values of r correspond to a partially synchronized or coherent 
state, depicted in Fig.10.33. Some phases are synchronized in a cluster, while others 
roam around the circle. 

Multiplying both sides of (10.21) by e~’”' and considering only the imaginary parts, 
we can rewrite (10.20) in the equivalent form 


yg, =w,+ Krsin(y — yj) , 


which emphasizes the mean-filed character of interactions between the oscillators: they 
are all pulled into the synchronized cluster (y; + w) with the effective strength pro- 
portional to the cluster size r. This pull is offset by the random frequency deviations 
w;, Which pull away from the cluster. 
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Let us assume that the frequencies w; are distributed randomly around 0 with a 
symmetric probability density function g(w) (e.g., Gaussian). Kuramoto (1975) has 
shown that in the limit n — oo, the cluster size r obeys the self-consistency equation 


+7 /2 
aT g(rK sin y) cos? y dy (10:22) 
—1/2 


derived in exercise 21. Note that r = 0, corresponding to the incoherent state, is always 
a solution of this equation. When the coupling strength K is greater than a certain 


critical value, 
2 


Me Fa(0) 
an additional, nontrivial solution r > 0 appears, which corresponds to a partially 
synchronized state. It scales as r = ,/16(K — K.)/(—g"(0)7K@), as the reader can 
prove by expanding g in a Taylor series. Thus, the stronger the coupling K relative 
to the random distribution of frequencies, the more oscillators synchronize into a co- 
herent cluster. The issue of stability of incoherent and partially synchronized states is 
discussed by Strogatz (2000). 


10.4 Examples 


Below we consider simple examples of oscillators to illustrate the theory developed in 
this chapter. Our goal is to understand which details of oscillators are important in 
shaping the PRC, the form of the function H in the phase deviation model, and, hence, 
the existence and stability of synchronized states. 


10.4.1 Phase Oscillators 


Let us consider the simplest possible kind of a nonlinear oscillator, known as the phase 
oscillator: 
z= f(x)+ep(t), xves', (10.23) 


where f(x) > 0 is a periodic function, for example, f(z) = a+ sinz with a > 1. 
Note that this kind of oscillator is quite different from the two- or high-dimensional 
conductance-based models with limit cycle attractors that we considered in the earlier 
chapters. Here, the state variable x is one-dimensional, defined on a circle S'. It may be 
interpreted as a measure of distance along a limit cycle attractor of a multi-dimensional 
system. 

Consider the unperturbed (¢ = 0) phase oscillator « = f(x), and let x(t) be its 
solution with some period T > 0. Following Kuramoto’s idea, we substitute x(V) into 
(10.23) and use the chain rule, 


f(a) + ep(t) = {x@)}' = 29) 0 = fa)", 
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to get the new phase equation 


3 =1+ ep(t)/f(2x(d)) , (10.24) 


which is equivalent to (10.23) for any, not necessarily small, e. 
We can also obtain (10.24) by using any of the three methods of reduction of 
oscillators to phase models: 


e Malkin’s method is the easiest one. We do not even have to solve the one- 
dimensional adjoint equation (10.10) having the form Q = — f’(x(t)) Q, because 
we can obtain the solution Q(t) = 1/f(ax(t)) directly from the normalization 
condition Q(t) f(x(t)) = 1. 


e Kuramoto’s method relies on the function V(x), which we can find implicitly. 
Since the phase at a point x(t) on the limit cycle is t, x(v) is the inverse of (2). 
Using the rule for differentiating of inverse functions, V’(x) = 1/2'(v), we find 


grad 0 = 1/f(x(v)). 


e Winfree’s method relies on PRC (v), which we find using the following procedure: 
A pulsed perturbation at phase J moves the solution from x(v) to x(V) + A, 
which is z(¥v + PRC (v, A)) © 2(V) + 2’(0)PRC (J, A) when A is small. Hence, 
PRC (J, A) & A/a'(v) = A/f(x(V)), and the linear response is Z7(V) = 1/f(x(v)) 
when A — 0. 


Two coupled identical oscillators 


£, = f(ri)+€9(%2) 
to = f (x2) +e€g(21) 


can be reduced to the phase model (10.17) with G(x) = H(—yx) — H(x), where 


1 fT galt +) 
al Fa) 


The condition for exponential stability of the in-phase synchronized state, y = 0, can 
be expressed in the following three equivalent forms 


(2) f(z) 
ey es 


Hxy= 7 f Walelt+x)at = 


g(x)dx >0, (10.25) 


fi g(x(t))dt>0 ~~ or 


aS we prove in exercise 24. 


10.4.2 SNIC Oscillators 


Let us go through all the steps of derivation of the phase equation using a neuron 
model exhibiting low-frequency periodic spiking. Such a model is near the saddle-node 
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Figure 10.34: Phase portraits and typical oscillations of the quadratic integrate-and-fire 
neuron ¢ = I + x? with x € RU {+00}. Parameter: J = —1,0,+1. 
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Figure 10.35: The dependence of the PRC of the quadratic integrate-and-fire model 
on the strength of the pulse A. 


on invariant circle (SNIC) bifurcation studied in section 6.1.2. Appropriate rescaling 
of the membrane potential and time converts the model into the normal form 


a =14+27, reER. 


Because of the quadratic term, x escapes to infinity in a finite time, producing a spike 
depicted in Fig.10.34. If we identify —oo and +00, then x exhibits periodic spiking of 
infinite amplitude. Such a spiking model is called a quadratic integrate-and-fire (QIF) 
neuron (see also section 8.1.3 for some generalizations of the model). 


Strong Pulse 


The solution of this system, starting at the spike, that is, at x(0) = too, is 
at) =—roit, 


as the reader can check by differentiating. It is a periodic function with T = 7; 
hence, we can introduce the phase of oscillation via the relation x = —cotv. The 
corresponding PRC can be found explicitly (see exercise 9) and it has the form 


PRC (0, A) = a7/2+ atan(A— cot?) -—#, 
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depicted in Fig.10.35, where A is the magnitude of the pulse. Note that the PRC tilts 
to the left as A increases. Indeed, the density of isochrons, denoted by black points on 
the x-axis in the figure, is maximal at the ghost of the saddle-node point x = 0, where 
the parabola 1 + x? has the knee. This corresponds to the inflection point of the graph 
of x(t) in Fig.10.34, where the dynamics of x(t) is the slowest. The effect of a pulse 
is maximal just before the ghost because x can jump over the ghost and skip the slow 
region. The stronger the pulse, the earlier it should arrive; hence the tilt. 


Weak Coupling 


The PRC behaves as Asin? J, with J € [0,7], when A is small, as the reader can 
see in Fig.10.35 or prove by differentiating the function PRC (v, A) with respect to A. 
Therefore, Z(7) = sin? 7, and we can use Winfree’s approach to transform the weakly 
perturbed quadratic integrate-and-fire (QIF) oscillator 


z’ =1+2* +4 ep(t) 
into its phase model 
g =1+ e(sin? ¥)p(t) , 0 € [0,7] . 
The results of the previous section, Q(7) = 1/f(a(7)) = 1/(1+cot? J) = sin? J, confirm 


the phase model. In fact, any neuronal model CV = I — J,,(V) near saddle-node on 
invariant circle bifurcation point (Jg,, Vin) has infinitesimal PRC: 


sin? 0 , 0 € [0,7], 


PRC (¥) = = g 


sn 


as the reader can prove as an exercise. The function sin?V has the same form as 
(1 — cos @) if we change variables 6 = 20 (notice the font difference). The change of 
variables scales the period from 7 to 27. 

In Fig.10.36a we compare the function with numerically obtained PRCs for the 
Ina + Ix-model in the Class 1 regime. Since the ghost of the saddle-node point, 
revealing itself as an inflection of the voltage trace in Fig.10.36b, moves to the right as 
I increases away from the bifurcation value J = 4.51, so does the peak of the PRC. 

Figure 10.36a emphasizes the common features of all systems undergoing saddle- 
node on invariant circle bifurcation: they are insensitive to the inputs arriving during 
the spike, since PRC = 0 when 7? = 0,7. The oscillators are most sensitive to the input 
when they are just entering the ghost of the resting state, where PRC is maximal. 
The location of the maximum tilts to the left as the strength of the input increases, 
and may tilt to the right as the distance to the bifurcation increases. Finally, PRCs 
are non-negative, so positive (negative) inputs can only advance (delay) the phase of 
oscillation. 
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Figure 10.36: (a) Numerically found PRCs of the Iya + [k-oscillator in Class 1 regime 
(parameters as in Fig.4.la) and various J using the MATLAB program in exercise 12. 
(b) Corresponding voltage traces show that the inflection point (slowest increase) of V 
moves right as J increases. 


Gap Junctions 


Now consider two oscillators coupled via gap junctions (discussed in section 2.3.4): 


5 = 1+2?+e(x2— 2%), 


ty = 1+a3+e(z1—22). 


Let us determine the stability of the in-phase synchronized state 7; = x2. The corre- 
sponding phase model (10.12) has the form 


W, = 1+ (sin? 0)(cot 9, — cot 92) , 
0 = 1+€(sin® 92)(cot %2 — cot) . 


The function (10.16) can be found analytically: 


Lg 1 
Ho) == [ sin’ ¢ (cot t — cot(t + y)) di = 5 sin 2x , 
0 


so that the model in the phase deviation coordinates, J(t) = t + y, has the form 
g, = (e/2)sin{2(¢2 — y1)} , 
~, = (e/2)sin{2(y1 — Y2)} . 

The phase difference, y = 2 — 1, satisfies the equation (compare with Fig.10.26) 


/ 


XY = -Esin2y , 


and, apparently, the in-phase synchronized state, y = 0, is always stable while the 
anti-phase state y = 7/2 is not. 
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Weak Pulses 


Now consider two weakly pulse-coupled oscillators 


£, = il c €10(t — te) , 
ty = In Pend (t— ti), 


where t; and ty are the moments of firing (z(t) = oo) of the first and the second 
oscillator, respectively, and ¢, and €2 are the strengths of synaptic connections. The 
corresponding phase model (10.12) has the form 


v1 = 1 + €1(sin® 9)6(t — te) 
v5 = 1+ €9(sin? 02)d(t — t1) 5 


Since 


L 1 
Hoy == | sin’ t6(t + x) dt = —sin® y , 
0 


the corresponding phase deviation model (10.15) is 
Ey. 
i = —sin’(p2— $i); 
€o.. 
yy = —sin?(y1 — ¢2). 
7 
The phase difference y = y2 — Y satisfies the equation 


yp €2— €] 


sin? x, 


which becomes y’ = 0 when the coupling is symmetric. In this case, the oscillators pre- 
serve (on average) the initial phase difference. When ¢; 4 €, the in-phase synchronized 
state y = 0 is only neutrally stable. Interestingly, it becomes exponentially unstable 
in a network of three or more pulse-coupled Class 1 oscillators (see exercise 23). 


Weak Pulses with Delays 


The synchronization properties of weakly pulse-coupled oscillators can change signifi- 
cantly when explicit axonal conduction delays are introduced. As an example, consider 
the system 


gv, = 1+2?+6c6(t-t.—-d), 
gw = 1+22+ed(t-—t,—d), 


where d > 0 is the delay. exercise 18 shows that delays introduce simple phase shifts, 
so that the phase model has the form 


E, 
Yi = —sin’(~2 — 1 — 4) , 


N 
~ = —sin’(y1 — ¢2 — d) , 
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Figure 10.37: Synaptic transmission function p(t) typically has an asymmetric shape 
with fast rise and slow decay. 

The phase difference y = yo — yy, satisfies 


esin2d , 
sin 2y . 


x= = (sin? (x +d) —sin?(x — d)) = 


The stability of synchronized states is determined by the sign of the function sin 2d. 
The in-phase state y = 0 is unstable when sin 2d > 0, that is, when the delay is shorter 
than the half-period 7/2, stable when the delay is longer than the half-period but 
shorter than one period 7, unstable for even longer delays, and so on. The stability of 
the anti-phase state y = 7/2 is reversed, that is, it is stable for short delays, unstable 
for longer delays, then stable again for even longer delays, and so on. Finally, when the 
pulses are inhibitory (€ < 0), the (in)stability character is flipped so that the in-phase 
state becomes stable for short delays. 


Weak Synapses 


Now suppose that each pulse is not a delta function, but is smeared in time (i.e., it 
has a time course p(t — t;) with p(0) = p(z) = 0). That is, the synaptic transmission 
starts right after the spike of the presynaptic neuron and ends before the onset of 
the next spike. The function p has a typical unimodal shape with fast rise and slow 
decay, depicted in Fig.10.37. The discussion below is equally applicable to the case of 
p(t,x) = g(t)(E — x) with g > 0 being the synaptic conductance with the shape in 
the figure and F being the synaptic reverse potential, positive (negative) for excitatory 
(inhibitory) synapses. 
Two weakly synaptically coupled SNIC (Class 1) oscillators 


g = 1+23+ep(t—t), 
wy = 1+23+ep(t—t) 


can be converted into a general phase model with the connection function (10.16) in 
the form 


1 TT 
Hy -{ sin” t p(t + x) dt , 
0 
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Figure 10.38: Top. Periodic spiking of the Jy,+ J,-neuron near saddle-node homoclinic 
orbit bifurcation (parameters as in Fig.4.la with 7(V) = 0.167 and J = 4.49). Bottom. 
Spiking in the corresponding quadratic integrate-and-fire model. 


and it can be computed explicitly for some simple p(t). 
The in-phase synchronized solution, y = 0, is stable when 


1 Tv 
H'(0) = -{ sin’ t p'(t) dt >0. 
0 


Since the function sin?¢ depicted in Fig.10.37 is small at the ends of the interval and 
large in the middle, the integral is dominated by the sign of p’ in the middle. Fast-rising 
and slowly decaying excitatory (p > 0) synaptic transmission has p’ < 0 in the middle 
(as in the figure), so the integral is negative and the in-phase solution is unstable. In 
contrast, fast-rising slowly decaying inhibitory (p < 0) synaptic transmission has p’ > 0 
in the middle, so the integral is positive and the in-phase solution is stable. Another 
way to see this is to integrate the equation by parts, reduce it to — f p(t) sin 2¢ de, 
and note that p(t) is concentrated in the first (left) half of the period, where sin 2t 
is positive. Hence, positive (excitatory) p results in H’(0) < 0, and vice versa. Both 
approaches confirm the theoretical results independently obtained by van Vreeswijk 
et al. (1994) and Hansel et al. (1995) that inhibition, not excitation, synchronizes 
Class 1 (SNIC) oscillators. The relationship is inverted for the anti-phase solution 
x = 7/2 (the reader should prove this), and no relationships are known for other types 
of oscillators. 


10.4.3. Homoclinic Oscillators 


Besides the SNIC bifurcation considered above, low-frequency oscillations may also 
indicate the proximity of the system to a saddle homoclinic orbit bifurcation, as in 
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Figure 10.39: (a) Numerically found PRCs of the Iy, + [,-oscillator near saddle-node 
homoclinic orbit bifurcation (as in Fig.10.38), using the MATLAB program in exer- 
cise 12. Magnification shows the divergence from the theoretical curve sinh?(/ — T) 
during the spike. (b) A pulsed input during the downstroke of the spike can produce a 
significant phase delay (pulse A) or advance (pulse B) not captured by the quadratic 
integrate-and-fire model. 


Fig.10.38 (top). The spiking trajectory in the figure quickly approaches a small shaded 
neighborhood of the saddle along the stable direction, and then slowly diverges from 
the saddle along the unstable direction, thereby resulting in a large-period oscillation. 
As often the case in neuronal models, the saddle equilibrium is near a stable node 
equilibrium corresponding to the resting state, and the system is near the codimension- 
2 saddle-node homoclinic orbit bifurcation studied in section 6.3.6. As a result, there 
is a drastic difference between the attraction and divergence rates to the saddle, so 
that the dynamics in the shaded neighborhood of the saddle-node in the figure can be 
reduced to the one-dimensional V-equation, which in turn can be transformed into the 
“quadratic integrate-and-fire” form 


vg = —-1+2?, if ¢ = +00, then © reset ; 


with solutions depicted in Fig.10.38 (bottom). The saddle and the node correspond 
to « = +1 and x = —1, respectively. One can check by differentiating that the 
solution of the model with x(0) = Zreset > 1 is x(t) = —coth(t — T), where coth(s) = 
(e* +e *)/(e* —e-*) is the hyperbolic cotangent and T = acoth (reset) is the period of 
oscillation, which becomes infinite as Xreset > 1. 

Using the results of section 10.4.1, we find the function 


Q(9) = 1/(—1+4 coth?(8 — T)) = sinh?(3 — T) 


whose graph is shown in Fig.10.39a. For comparison, we plotted the numerically found 
PRC for the Jy, + Jx-oscillator to illustrate the disagreement between the theoretical 
and numerical curves in the region 0 < 0.17 corresponding to the downstroke of 
the spike. Such a disagreement is somewhat expected, since the quadratic integrate- 
and-fire model ignores spike downstroke. If a pulse arriving during the downstroke 
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displaces the trajectory to the exterior of the limit cycle (as in Fig.10.39b, pulse A), 
then the trajectory becomes closer to the saddle equilibrium when it reenters a small 
neighborhood of the saddle, thereby leading to a significant phase delay. Displacements 
to the interior of the cycle (as in Fig.10.39b, pulse B) push away from the saddle 
and lead to phase advances. The direction and the magnitude of displacements are 
determined by the derivative of the slow variable n’ along the limit cycle. 

The region of disagreement between theoretical and numerical PRCs becomes in- 
finitesimal relative to T’ — oo near the bifurcation. Theoretical PRC can be used to 
study anti-phase and out-of-phase synchronization of pulse-coupled oscillators, but not 
of in-phase synchronization, because the region of breakdown is the only important 
region in this case. Finally, note that as T’ — oo, the spiking limit cycle fails to be ex- 
ponentially stable, and the theory of weakly coupled oscillators is no longer applicable 
to it. 

Though the PRC in Fig.10.39 is quite different from the one corresponding to 
SNIC oscillators in Fig.10.36, there is an interesting similarity between these two cases: 
both can be reduced to quadratic integrate-and-fire neurons, and both have cotangent- 
shaped periodic spiking solutions and sine-squared-shape PRCs, except that they are 
“regular” in the SNIC case and hyperbolic in the homoclinic case (see also exercise 26). 


10.4.4 Relaxation Oscillators and FTM 


Consider two relaxation oscillators having weak fast + fast connections 


pt; = f (ai, yi) + epi(wi, tn) , (10.26) 
Y= g (Xi, Yi) 


where 7 = 1,2 and k = 2,1. This system can be converted to a phase model in the 
relaxation limit ¢ < ys — 0 (Izhikevich 2000b). The connection functions H;(x) have a 
positive discontinuity at x = 0, which occurs because the x-coordinate of the relaxation 
limit cycle is discontinuous at the jump points. Hence, the phase difference function 
G(x) = H2(—x) — Hi(x) has a negative discontinuity at ~ = 0 (depicted in Fig.10.31). 
This reflects the profound difference between behaviors of weakly coupled oscillators 
of the relaxation and non-relaxation types, discussed in section 10.3.1: The in-phase 
synchronized solution, y = 0, in the relaxation limit  — 0 is stable and persistent 
in the presence of the frequency mismatch w, and it has a rapid rate of convergence. 
The reduction to a phase model breaks down when ¢ > yp — 0, that is, when the 
connections are relatively strong. One can still analyze such oscillators in the special 
case considered below. 


Fast Threshold Modulation 


Consider (10.26) and suppose that p; = po = p is a piecewise constant function: p = 1 
when the presynaptic oscillator, x,, is on the right branch of the cubic x-nullcline 
corresponding to an active state, and p = 0 otherwise (see Fig.10.40a). Somers and 
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Figure 10.40: Fast threshold modulation of relaxation oscillation. (a) The Heaviside 
or sigmoidal coupling function p(x) is constant while z is on the left or right branch of 
the x-nullcline. (b) In the relaxation limit = 0, the synchronized limit cycle consists 
of the left branch of the nullcline f(x,y) = 0 and the right branch of the nullcline 
f(x,y) +¢ = 0. When oscillator 1 is ahead of oscillator 2 (c), the phase difference 
between them decreases after the jump (d). 


Kopell (1993, 1995) referred to such a coupling in the relaxation limit ~ — 0 as fast 
threshold modulation (FTM), and found a simple criterion of stability of synchronized 
state that works even for strong coupling. 

Since the oscillators are identical, the in-phase synchronized state exists, during 
which the variables x, and 2x2 follow the left branch of the z-nullcline defined by 
f(x,y) = 0 (see Fig.10.40b) until they reach the jumping point a. During the in- 
stantaneous jump, they turn on the mutual coupling ¢, and land at some point b’ on 
the perturbed z-nullcline defined by f(x,y) + ¢ = 0. They follow the new nullcline to 
the right (upper) knee, and then jump back to the left branch. 

To determine the stability of the in-phase synchronization, we consider the case 
when oscillator 1 is slightly ahead of oscillator 2, as in Fig.10.40c. We assume that the 
phase difference between the oscillators is so small — or alternatively, the strength of 
coupling is so large — that when oscillator 1 jumps and turns on its input to oscillator 
2, the latter, being at point d in Fig.10.40d, is below the left knee of the perturbed 
x-nullcline f(x,y) +¢ = 0 and therefore jumps, too. As a result, both oscillators jump 
to the perturbed x-nullcline and reverse their order. Although the apparent distance 
between the oscillators, measured by the difference of their y-coordinates, is preserved 
during such a jump, the phase difference between them usually is not. 

The phase difference between two points on a limit cycle is the time needed to 
travel from one point to the other. Let 79(d) be the time needed to slide from point 
d to point a along the x-nullcline in Fig.10.40d (i.e., the phase difference just before 
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the jump). Let 7,(d) be the time needed to slide from point b’ to point d’ (i.e., the 
phase difference after the jump). The phase difference between the oscillators during 
the jump changes by the factor C(d) = 7(d)/70(d), called the compression function. 
The difference decreases when the compression function C(d) < 1 uniformly for all d 
near the left knee a. This condition has a simple geometrical meaning: the rate of 
change of y(t) is slower before the jump than after it, so that y(t) has a “scalloped” 
shape, as in Fig.10.40c. As an exercise, prove that C(d) — |g(a)|/|g(0')| as d > a. 

If the compression function at the right (upper) knee is also less than 1, then the 
in-phase synchronization is stable. Indeed, the phase difference does not change while 
the oscillators slide along the nullclines, and it decreases geometrically with each jump. 
In fact, it suffices to require that the product of compression factors at the two knees 
be less than 1, so that any expansion at one knee is compensated for by even stronger 
compression at the other knee. 


10.4.5 Bursting Oscillators 


Let us consider bursting neurons coupled weakly through their fast variables: 


te = FLU) Peoples zc) )s (10.27) 
Yi = gi, Mi) | (10.28) 


7 = 1,2 and j = 2,1. Since bursting involves two time scales, fast spiking and slow 
transition between spiking and resting, there are two synchronization regimes: spike 
synchronization and burst synchronization, illustrated in Fig.9.51 and discussed in 
section 9.4. Below, we outline some useful ideas and methods of studying both regimes. 
Our exposition is not complete, but it lays the foundation for a more detailed research 
program. 


Spike Synchronization 


To study synchronization of individual spikes within the burst, we let ~ = 0 in order to 
freeze the slow subsystem (10.28), and consider the fast subsystem (10.27) describing 
weakly coupled oscillators. When y; * y,;, the fast variables oscillate with approxi- 
mately equal periods, so (10.27) can be reduced to the phase model 


where y; = const parameterize the form of the connection function. For example, 
during the “circle/Hopf” burst, the function is transformed from H(x) = sin? x or 
1 — cosy at the beginning of the burst (saddle-node on invariant circle bifurcation) 
to H(y) = siny at the end of the burst (supercritical Andronov-Hopf bifurcation). 
Changing y; slowly, one can study when spike synchronization appears and when it 
disappears during the burst. When the slow variables y; have different values, fast 
variables typically oscillate with different frequencies, so one needs to look at low-order 
resonances to study the possibility of spike synchronization. 
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Figure 10.41: Reduction of the INap+Jk+Jk(m)-burster to a relaxation oscillator. The 
slow variable exhibits “scalloped” oscillations needed for stability of in-phase burst 
synchronization. C, and Cy are compression functions at the two jumps. 


Burst synchronization 


In chapter 9 we presented two methods, averaging and equivalent voltage, that remove 
fast oscillations and reduce bursters to slow relaxation oscillators. Burst synchroniza- 
tion is then reduced to synchronization of such oscillators, and it can be studied using 
phase reduction or fast threshold modulation (FTM) approaches. 

To apply FTM, we assume that the coupling in (10.27) is piecewise constant, that 
is, p(x;,x;) = 0 when the presynaptic burster x, is resting, and p(;,7;) = 1 (or any 
function of x;) when the presynaptic burster is spiking. We also assume that the slow 
subsystem (10.28) is one-dimensional, so that we can use the equivalent voltage method 
(section 9.2.4) and reduce the coupled system to 


0 = Xeauiv VED) Xi, 
Y, = g(i, Yi) - 


When the burster is of the hysteresis loop type (i.e., the resting and spiking states 
coexist), the function x = Xequiv(y, ep) often, but not always, has a Z-shape on the 
slow/fast plane, as in Fig.9.16, so that the system corresponds to a relaxation oscilla- 
tor with nullclines as in Fig.10.41. Fast threshold modulation occurs via the constant 
ep, which shifts the fast nullcline up or down. The compression criterion for stability 
of the in-phase burst synchronization, presented in the previous section, has a simple 
geometrical illustration in the figure. The slow nullcline has to be sufficiently close 
to the jumping points that y(t) slows before each jump and produces the “scalloped” 
curve. Many hysteresis loop fast/slow bursters do generate such a shape. In partic- 
ular, “fold/*” bursters exhibit robust in-phase burst synchronization when they are 
near the bifurcation from quiescence to bursting, since the slow nullcline is so close to 
the left knee that the compression during the resting — spiking jump (C{ in Fig.10.41) 
dominates the expansion, if any, during the spiking — resting jump. 
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Review of Important Concepts 


Oscillations are described by their phase variables v7 rotating on a circle 
S'. We define as the time since the last spike. 


The phase response curve, PRC (v), describes the magnitude of the phase 
shift of an oscillator caused by a strong pulsed input arriving at phase V. 


PRC depends on the bifurcations of the spiking limit cycle, and it defines 
synchronization properties of an oscillator. 


Two oscillators are synchronized in-phase, anti-phase, or out-of-phase 
when their phase difference, Jz —V,, equals 0, half-period, or some other 
value, respectively; see Fig.10.42. 


Synchronized states of pulse-coupled oscillators are fixed points of the 
corresponding Poincare phase map. 


Weakly coupled oscillators 
t= fa) +e) g(a; 
can be reduced to phase models 
U—=1 +e) > gales), 
where Q(V) is the infinitesimal PRC defined by (10.10). 


Weak coupling induces a slow phase deviation of the natural oscillation, 
0,;(t) =t + y;, described by the averaged model 


Pi =e (wi ar SS) His (¢; = i)) ; 


where w; denote the frequency deviations, and 


Hyloj— 0) = f QU) aylaslt-+v5—vd))ae 


describes the interactions between the phases. 


Synchronization of two coupled oscillators corresponds to equilibria of 
the one-dimensional system 


X =e(w+ G(x)) , X=P2-1, 


where G(x) = Ho1(—x) — Hie2(x) describes how the phase difference y 
compensates for the frequency mismatch w = W2 — w}. 
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in-phase anti-phase out-of-phase 


Figure 10.42: Different types of synchronization. 


Bibliographical Notes 


Surprisingly, this chapter turned out to be quite different from chapter 9 (“Weakly 
Connected Oscillators”) of the book Weakly Connected Neural Networks by Hoppen- 
steadt and Izhikevich (1997) and from the book Synchronization: A Universal Concept 
in Nonlinear Sciences by Pikovsky, Rosenblum, and Kurths (2001). All three texts, 
though devoted to the same subject, do not repeat, but rather complement, each other. 
The last provides an excellent historical overview of synchronization, starting with the 
work of the famous Dutch mathematician, astronomer, and physicist Christiaan Huy- 
gens (1629-1695), who was the first to describe synchronization of two pendulum clocks 
hanging from a common support (which was, incidentally, anti-phase). While providing 
many examples of synchronization of biological, chemical, and physical systems, the 
book by Pikovsky et al. also discusses the definition of a phase and synchronization of 
nonperiodic, e.g., chaotic, oscillators, a topic not covered here. A major part of Spiking 
Neuron Models by Gerstner and Kistler (2002) is devoted to synchronization of spik- 
ing neurons, with the emphasis on the integrate-and-fire model and the spike-response 
method. 

The formalism of the phase response curve (PRC) was introduced by Hastings 
and Sweeney (1958), and it has been used extensively in the context of resetting the 
circadian rhythms. “Forty Years of PRC — What Have We Learned?” by Johnson 
(1999) gives a historical overview of this idea and some recent developments. John 
Guckenheimer (1975) used the theory of normally hyperbolic invariant manifolds to 
provide a mathematical foundation for the existence of isochrons, and their geometrical 
properties. An encyclopedic exposition on isochrons and phase-resettings in nature, as 
well as numerous anecdotes, can be found in Arthur Winfree’s remarkable book The 
Geometry of Biological Time (1980, 2nd ed., 2001). In particular, Winfree describes 
the work of George R. Mines (1914), who was doing phase-resetting experiments by 
shocking rabbits at various phases of their heartbeat. He found the phase and shock 
that could stop a rabbit’s heart (black hole in Fig.10.8), and then applied it to himself. 
He died. 

Glass and Mackey (1988) provide a detailed exposition of circle phase maps. Al 
though the structure of phase-locking regions in Fig.10.15 was discovered by Cartwright 
and Littlewood (1945), it is better known today as Arnold tongues (Arnold 1965). Gue- 
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Figure 10.43: Frank Hoppensteadt, 
the author’s adviser and mentor, circa 
1989. 


vara and Glass (1982) found this structure analytically for the Andronov-Hopf oscillator 
in Fig.10.3 (radial isochron clock). Hoppensteadt (1997, 2000) provides many examples 
of oscillatory systems arising in biology and neuroscience (see also Hoppensteadt and 
Peskin 2002). 

Malkin’s method of reduction of coupled oscillators to phase equations has been 
known, at least to Russian scientists, since the early 1950s (Malkin 1949, 1956; Blech- 
man 1971). For example, Melnikov (1963) applied Malkin’s theorem to a homoclinic 
orbit of infinite period to obtain the transversality condition for the saddle homoclinic 
orbit bifurcation (Kuznetsov 1995). 

Malkin’s method was rediscovered in the West by Neu (1979), and hoorayed by 
Winfree (1980), who finally saw a mathematical justification for his usage of phase 
variables. Since then, the field of phase equations has been largely dominated by Bard 
Ermentrout and Nancy Kopell (Ermentrout 1981, 1986, 1992; Ermentrout and Kopell 
1986a,b, 1990, 1991, 1994; Kopell and Ermentrout 1990; Kopell 1986; Kopell et al. 
1991). In particular, they developed the theory of traveling wave solutions in chains 
of oscillators, building on the seminal paper by Cohen et al. (1982). Incidentally, the 
one-page proof of Malkin’s theorem provided by Hoppensteadt and Izhikevich (1997, 
Sect. 9.6) is based on Ermentrout and Kopell’s idea of using the Fredholm alternative; 
Malkin’s and Neu’s proofs are quite long, mostly because they reprove the alternative. 

There are only a handful of examples in which the Malkin adjoint problem can be 
solved analytically (i-e., without resort to simulations). The SNIC, homoclinic and 
Andronov-Hopf cases are the most important, and have been considered in detail in 
this chapter. Brown et al. (2004) also derive PRCs for oscillators with homoclinic 
orbits to pure saddles (see exercise 25) and for Bautin oscillators. 

Throughout this chapter we define the phase ? or y on the interval [0,7], where T 
is the period of free oscillation, and do not normalize it to be on the interval [0, 27]. 
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Figure 10.44: Nancy Kopell in her Boston University office in 1990 (photograph pro- 
vided by Dr. Kopell). 


As a result, we have avoided the annoying terms 27/T and 27/Q in the formulas. The 
only drawback is that some of the results may have an “unfamiliar look”, such as sin? J 
with J € [0,7] for the PRC of Class 1 neurons, as opposed to 1 — cos ¥ with V € [0, 27] 
used previously by many authors before. 

Hansel, Mato, and Meunier (1995) were the first to note that the shape of the PRC 
determines the synchronization properties of synaptically coupled oscillators. Ermen- 
trout (1996) related this result to the classification of oscillators and proved that PRCs 
of all Class 1 oscillators have the form of 1 — cosV, though the proof can be found 
in his earlier papers with Kopell (Ermentrout and Kopell 1986a, 1986b). Reyes and 
Fetz (1993) measured the PRC of a cat neocortical neuron and largely confirmed the 
theoretical predictions. The experimental method in section 10.2.4 is related to that 
of Rosenblum and Pikovsky (2001). It needs to be developed further, for instance, by 
incorporating the measurement uncertainty (error bars). In fact, most experimentally 
obtained PRCs, including the one in Fig.10.24, are so noisy that nothing useful can be 
derived from them. This issue is the subject of active research. 

Our treatment of the FTM theory in this volume closely follows that of Somers and 
Kopell (1993, 1995). Anti-phase synchronization of relaxation oscillators is analyzed 
using phase models by Izhikevich (2000b), and FTM theory, by Kopell and Somers 
(1995). Ermentrout (1994) and Izhikevich (1998) considered weakly coupled oscilla- 
tors with axonal conduction delays and showed that delays result in mere phase shifts 
(see exercise 18). Frankel and Kiemel (1993) observed that slow coupling can be re- 
duced to weak coupling. Izhikevich and Hoppensteadt (2003) used Malkin’s theorem 
to extend the results to slowly coupled networks, and to derive useful formulas for the 
coupling functions and coefficients. Ermentrout (2003) showed that the result could 
be generalized to synapses having fast-rising and slow-decaying conductances. Goel 
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and Ermentrout (2002) and Katriel (2005) obtained interesting results on in-phase 
synchronization of identical phase oscillators. 

Interactions between resonant oscillators were considered by Ermentrout (1981), 
Hoppensteadt and Izhikevich (1997), and Izhikevich (1999) in the context of quasi- 
periodic (multi-frequency) oscillations. Baesens et al. (1991) undertook the heroic 
task of studying resonances and toroidal chaos in a system of three coupled phase 
oscillators. Mean-field approaches to the Kuramoto model are reviewed by Strogatz 
(2000) and Acebron et al. (2005). Daido (1996) extended the theory to the general 
coupling function H(y). van Hemmen and Wreszinski (1993) were the first to find the 
Lyapunov function for the Kuramoto model, which was generalized (independently) by 
Hoppensteadt and Izhikevich (1997) to the arbitrary coupling function H(y). 

Ermentrout (1986), Aronson et al. (1990), and Hoppensteadt and Izhikevich (1996, 
1997) studied weakly coupled Andronov-Hopf oscillators, and discussed the phenomena 
of self-ignition (coupling-induced oscillations) and oscillator death (coupling-induced 
cessation of oscillation). Collins and Stewart (1993, 1994) and Golubitsky and Stewart 
(2002) applied group theory to the study of synchronization of coupled oscillators in 
networks with symmetries. 

In this chapter we have considered either strong pulsed coupling or weak continuous 
coupling. These limitations are severe, but they allow us to derive model-independent 
results. Studying synchronization in networks of strongly coupled neurons is an active 
area of research, though, most such studies fall into two categories: (1) simulations 
and (2) integrate-and-fire networks. In both cases, the results are model-dependent. If 
the reader wants to pursue this line of research, he or she will definitely need to read 
Mirollo and Strogatz (1990), van Vreeswijk et al. (1994), Chow and Kopell (2000), 
Rubin and Terman (2000, 2002), Bressloff and Coombes (2000), van Vreeswijk (2000), 
van Vreeswijk and Hansel (2001), Pfeuty et al. (2003), and Hansel and Mato (2003). 


Exercises 
1. Find the isochrons of the Andronov-Hopf oscillator 
z=(1+i)z—-2|z\’, zeéEC, 
in Fig.10.3. 
2. Prove that the isochrons of the Andronov-Hopf oscillator in the form 
z= (1+i)z+ (-1+ di)z|z/’, zeéEC, 


are the curves 
2(s) = sCH®) ex! | > 0 


where y is the phase of the isochron (see Fig.10.45). 
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g(1+di) 


(-1 +d) 


- 0 1 1 0 1 


Figure 10.45: Isochrons of the Andronov-Hopf oscillator; see exercise 2. 


(cos 0, sin @) (A+cos 0, sin 0) 


Figure 10.46: Pulsed stimulation of the 
Andronov-Hopf oscillator in Fig.10.3; 
see exercise 4. 


3. [MATLAB] To determine isochrons of an oscillator ¢ = F(x), one can start with 


many initial points near the limit cycle and integrate the system backwards, that 
is, ¢ = —F (ax). The images of the points at any time t lie on the same isochron. 
Write a MATLAB program that implements this algorithm. 


. Prove that the phase response curve of the Andronoy-Hopf oscillator in Fig.10.3 
is 


_ J -—b when 0<v<7, 
PRC (0, A) -{ Say cone ie oe (10.29) 
where 
1+ Acos¥? 
w = arcos 
V1+2Acos¥ + A? 


and A is the magnitude of the horizontal displacement of z(t); see Fig.10.46. 


. [MATLAB] Write a program that stimulates an oscillator at different phases and 
determines its phase response curve (PRC). 


. Show that Z(v) = gradV, so that Winfree’s phase model (10.6) is equivalent to 
Kuramoto’s phase model (10.8). 


. Show that Z7(V) = Q(v), so that Winfree’s phase model (10.6) is equivalent to 
Malkin’s phase model (10.9). 
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8. 


10. 


LM, 


12, 


13. 


14. 


Synchronization 


Show that the PRC of the leaky integrate-and-fire neuron (section 8.1.1) 
v=b-v, if v > 1 (threshold), then v < 0 (reset) 
with b > 1 has the form 
PRC (vV) = min {In(b/(bexp(—v) — A)),T}-—0, 


where T’ = In(b/(b — 1)) is the period of free oscillations and A is the amplitude 
of the pulse. 


. Prove that the quadratic integrate-and-fire neuron 


pele, if v = +00 (peak of spike), then v < —oo (reset) 
has PTC (¥) = 7/2 + atan(A— cot ¥). 
Find the PRC of the quadratic integrate-and-fire neuron (section 8.1.3) 
0=b+0’", if v > 1 (peak of spike), then v < Vyesct (reset) 
with b > 0. 


Consider two mutually pulsed coupled oscillators with periods T| + T> and type 
1 phase transition curves PTC; and PTC, respectively. Show that the locking 
behavior of the system can be described by the Poincare phase map 


Xn = T = PTC, (To = PTCo2(xn)) 5 


where x, is the phase difference between the oscillators, that is, the phase of 
oscillator 2 when oscillator 1 fires a spike. 


[MATLAB] Write a program that solves the adjoint equation (10.10) numerically. 
(Hint: Integrate the equation backward to achieve stability. ) 


[MATLAB] Write a program that finds the infinitesimal PRC using the relation- 
ship 


§ =14PRC(¥) ep(t), 


the moments of firings of a neuron (zero crossings of J(t)), and the injected 
current ep(t); see section 10.2.4 and Fig.10.24. 


Use the approaches of Winfree, Kuramoto, and Malkin to transform the integrate- 
and-fire neuron t = b —v + ep(t) in exercise 8 into its phase model 


8=1+e(e"/b) p(t), 


with T = In(b/(b — 1)). 
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15. 


16. 


sre 


18. 


19; 


Use the approaches of Winfree, Kuramoto, and Malkin to transform the quadratic 
integrate-and-fire neuron ( = 1 + v? + ep(t) in exercise 9 into its phase model 


8} =1+e(sin? 9) p(t) , 
with T = 7. 


Use the approaches of Winfree, Kuramoto, and Malkin to transform the Andronoy- 

Hopf oscillator 2 = (1 +i)z — z|z|? + ep(t) with real p(t) into its phase model 
§=1+e(—sinV)p(t) , 

with T = 27. 


(PRC for Andronoyv-Hopf) Consider a weakly perturbed system near supercritical 
Andronov-Hopf bifurcation (see section 6.1.3) 


z= (b+i)z+(-14di)z|z|? + p(t), zeEC. 


with b > 0. Let ¢ = bV/b/e be small. Prove that the corresponding phase model 
is 


6=1+d+elm{(1+di)p(t)e} . 


When the forcing p(t) is one-dimensional (i.e., p(t) = cq(t) with c € C and scalar 
function q(t)), the phase model has the sinusoidal form 


6=14+d+essin(6 — q(t) , 
with the strength s and the phase shift ~ depending only on d and c. 


(Delayed coupling) Show that weakly coupled oscillators 
cafe aoe) 
j=l 
with explicit axonal conduction delays d;; > 0 have the phase model 
YG, = wit 3 His (p5 — dig — i) 
Hi 


where ‘= d/dr, 7 = t is the slow time, and H(y) is defined by (10.16). Thus, 
explicit delays result in explicit phase shifts. 


Determine the existence and stability of synchronized states in the system 


Y1 = &Wyrcy sin(y2 = 1) 
(po = Wat C2 sin(y} = 2) 


as a function of the parameters w = w2 — w, and c= c2 — cy. 
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20. 


21. 
22. 


23. 


24. 
20; 


26. 


Synchronization 


Consider the Kuramoto model 
gi =wt > ci sin(y; + bij — Gi) 5 
j=l 

where c;; and ~,; are parameters. What can you say about its synchronization 
properties? 
Derive the self-consistency equation (10.22) for the Kuramoto model (10.20). 
Consider the phase deviation model 

yy = wtcH(y2— 1) 

~, = wt cH(y1 — 2) 


with an even function H(—x) = H(y). Prove that the in-phase synchronized 
state, Y1 = o, if it exists, cannot be exponentially stable. What can you say 
about the anti-phase state y1 = y2 + T/2? 


Prove that the in-phase synchronized state in a network of three or more pulse 
coupled quadratic integrate-and-fire neurons is unstable. 


Prove (10.25). 


(Brown et al. 2004) Show that the PRC for an oscillator near saddle homoclinic 
orbit bifurcation scales as PRC (J) ~ e*7-”), where X is the positive eigenvalue 
of the saddle and T is the period of oscillation. 


Consider the quadratic integrate-and-fire neuron « = +1+ 2? with the resetting 
“if 2 = +o0, then © © reset”. Prove that 


regime SNIC homoclinic 
model gfS4ilae¢ ef St a (Pea > 1) 


Xreset 


period T 1/2 — atan Lreset acoth reset 
solution x(t) — cot(t — T) —coth(t — T) 
PRC Q(d) sin?(o — T) sinh?(0 — T) 


Xreset=t1 a 


Xreset="1-1 


Synchronization 439 


g(x, y)=0 fix, y)=0 u << l2(a,)I Ig(ay)l << 


Figure 10.47: Left: Relaxation oscillator in the limit 4 = 0 near the onset of oscillation. 
Middle and right: A magnification of a neighborhood of the jump point a, for various 
g(a,) and yz. Canard solutions can appear when g(a,) < wu. 


2h 


28. 


29. 


30. 


where coth, acoth, and sinh are hyperbolic cotangent, hyperbolic inverse cotan- 
gent and hyperbolic sine, respectively. 


[M.S.] Derive the PRC for an oscillator near saddle homoclinic orbit bifurcation 
that is valid during the spike downstroke. Take advantage of the observation in 
Fig.10.39 that the homoclinic orbit consists of two qualitatively different parts. 


[M.S.] Derive the PRC for a generic oscillator near fold limit cycle bifurcation 
(beware of the problems of defining the phase near such a bifurcation). 


[M.S.] Simplify the connection function H for coupled relaxation oscillators 
(Izhikevich 2000b) when the slow nullcline approaches the left knee, as in Fig.10.47. 
Explore the range of parameters ¢, 4, and |g(a1)| where the analysis is valid. 


[Ph.D.] Use ideas outlined in section 10.4.5 to develop the theory of reduction of 
weakly coupled bursters to phase models. Do not assume that bursting trajectory 
is periodic. 
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Solutions to Exercises 


Solutions for chapter 2 


1. T= 20°C & 293°F. 


RT | [lonjou, 8315-293 -1n10 [lon]out [Ton]out 
E on — I] = l = +58 | a 
ton 2F  [lonin 296480. ©! [onlin °810 “Tonlin 
when z = +1. Therefore, 
Ex = 58 log(20/430) = —77 mV 
Ex, = 58 log(440/50) = 55 mV 
Eq = —58log(560/65) = —54 mV 
2 
I = Gnap(V — Ena) + 9K P(V — Ex) = p{(Gna + 9K) V — GNa Ena — Gk Ex} 
x! P GNa Ena + 9K “) 
= ao V = 7 
(Gna + 9k) P ( Bee ae 
—>__—_-’ —— 
g E 
3. The answer follows from the equation 
I—gt(V — Ey) =—g1(V — Ey) 5 where Ey = Ey +1/o, . 
4. See Fig.S.1. 
Function Vj /2 k Function Vinax OF Camp Chase 
Noo (V) 12 15 ™m(V) —14 50 4.7 1.1 
Moo(V) 25 9 ™(V) 27 30 0.46 0.04 
hoo (V) 3-7 ™m(V) —2 20 7.4 1.2 
Hodgkin and Huxley shifted Vj/z2 and Vinax by 65 mV so that the resting potential is at V = 0 
mV. 
5. (Willms et al. 1999) 
Vio = Vio = kIn(2'/? = 1) ; 
~ k 
eh 
2p(1 — 2-1/P) 


The first equation is obtained from the condition m?,(V; /2) = 1/2. The second equation is 
obtained from the condition that the two functions have the same slope at V = Vy /2- 


6. See author’s Web page, www.izhikevich.com. 


7. See author’s Web page, www.izhikevich.com. 
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Figure 8.1: Open dots: The steady-state (in)activation functions and voltage-sensitive time con- 
stants in the Hodgkin-Huxley model. Filled dots: steady-state Nat activation function m,,(V) in the 
squid giant axon (experimental results by Hodgkin and Huxley 1952, figure 8). Continuous curves: 
Approximations by Boltzmann and Gaussian functions. See exercise 4. 


Solutions for chapter 3 


1. Consider the limit case: (1) activation of the Na* current is instantaneous, and (2) conductance 
kinetics of the other currents are frozen. Then, the Na* current will result in the nonlinear 
term gna Moo(V)(V — Ena) with the parameter h.o(Vyest) incorporated into gna, and all the 
other currents will result in the linear leak term. 


In Fig.3.15, the activation of the Nat current is not instantaneous; hence the sag right after the 
pulses. In addition, its inactivation, and the kinetics of the other currents are not slow enough; 
hence the membrane potential quickly reaches the excited state and then slowly repolarizes to 
the resting state. 


2. See Fig.S.2. The eigenvalues are negative at each equilibrium marked as a filled circle (stable), 
and positive at each equilibrium marked as an open circle (unstable). The eigenvalue at the 
bifurcation point (left equilibrium in Fig.S.2b) is zero. 


F(V) F(V) F(V) 
aya Lad Sas 
a b 


Cc 


Figure §.2: Phase portraits of the system V = F(V) with given F(V). 


3. Phase portraits are shown in Fig.S.3. 


(a) The equation 0 = —1 + 2? has two solutions: « = —1 and x = +1; hence there are 
two equilibria in the system (a). The eigenvalues are the derivatives at each equilibrium, 
\ = (-1+ 27) = 22, where x = +1. Equilibrium z = —1 is stable because \ = —2 < 0. 
Equilibrium x = +1 is unstable because \ = +2 > 0. The same fact follows from the 
geometrical analysis in Fig.S.3. 
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(b) The equation 0 = x — x? has three solutions: x = +1 and x = 0; hence there are three 
caus in system (b). The eigenvalues are the derivatives at each equilibrium, A = 
(2 — #3)’ = 1-327. The equilibria x = +1 are stable because \ = 1 — 3(+1)? = —2 < 0. 
The equilibrium x = 0 is unstable because \ = 1 > 0. The same conclusions follow from 
the geometrical analysis in Fig.S.3. 


x 
1 x2-1 
0.5 
0.5 X 
x 0 
0— <——. —_ 
-0.5 
-0.5 
1 1 
2 1 0 1 2 2 1 0 1 2 
a b 


Figure 8.3: Phase portraits of the systems (a) ¢ = —1+ 27, and (b) ¢=2—- 2°. 


4. The equilibrium x = 0 is stable in all three cases. 


5. See Fig.S.4. Topologically equivalent systems are in (a), (b), and (c). In (d) there are different 
numbers of equilibria; no stretching or shrinking of the rubber phase line can produce new 
equilibria. In (e) the right equilibrium is unstable in V = F\(V) but stable in V = F2(V); no 
stretching or shrinking can change the stability of an equilibrium. In (f) the flow between the 
two equilibria is directed rightward in V = F,(V) and leftward in V = F(V); no stretching or 
shrinking can change the direction of the flow. 


6. (Saddle-node [fold] bifurcation in « = a +2?) The equation 0 = a + 2? has no real solutions 
when a > 0, and two solutions x = +,/|a| when a < 0. Hence there are two branches of 
equilibria, depicted in Fig.S.5. The eigenvalues are 


N= (ate?Y =2¢ = +2 lal . 


The lower branch —,/|a| is stable (A < 0), and the upper branch +,/|a| is unstable (A > 0). 
They meet at the saddle-node (fold) bifurcation point a = 0. 


(a)v=-1 at a=1 (b) x =-1/2 at a=1/4  (c)w=1/2 at a=1/4 
(d) x =4+1/V3 at a=+2/(3V3) (e)z=+1 at a= F2 (f)2=-1 at a=1 


8. (Pitchfork bifurcation in « = ba — 2°) The equation 0 = bx — x° has one solution « = 0 when 
b < 0, and three solutions x = 0, 2 = +Vb when b > 0. Hence there is only one branch of 
equilibria for b < 0 and three branches for 6 > 0 of the pitchfork curve depicted in Fig.S.6. The 
eigenvalues are 


d= (bx — 23) = b — 32”. 


The branch x = 0 exists for any b, and its eigenvalue is AX = b. Thus, it is stable for b < 0 and 
unstable for b > 0. The two branches x = +Vb exist only for b > 0, but they are always stable 
because A = b—3(4 —2b < 0. We see that the branch x = 0 loses stability when 6 passes 
the pitchfork bifurcation value b = 0, at which point a pair of new stable branches bifurcates 
(hence the name bifurcation). In other words, the stable branch x = 0 divides (bifurcates) into 
two stable branches when 0 passes 0. 


— 
TT 
S 
Na” 
No 
I 
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Topologically Topologically Topologically 
Equivalent Sy Equivalent 


Equivalent 


Topologically NOT Topologically NOT 
Equivalent Equivalent 


Left 
<i 


és a} 


Figure $.4: Answer to chapter 3, exercise 5. 


Recall that the current Jj, is turned off by depolarization and turned on by hyperpolarization. 
The dynamics of the [xjr-model is similar to that of the [Na,p-model in many respects. In par- 
ticular, this system can also have coexistence of two stable equilibria separated by an unstable 
equilibrium, which follows from the N-shaped I-V relation. Indeed, when V is hyperpolarized, 
the current Ix; is turned on (deinactivated), and it pulls V toward Ex. In contrast, when V is 
depolarized, the current is turned off (inactivated), and does not obstruct further depolarization 
of V. 


Use (3.11) to find the curve 


in Fig.S.8. (The curve may not be S-shaped if a different bifurcation parameter is used, as in 
exercise 12a below). 


The bifurcation diagram of the Ixj,-model (3.11) in Fig.S.8 has three branches corresponding 
to the three equilibria. When the parameter J is relatively small, the outward [xi, current 
dominates and the system has only one equilibrium in the low voltage range — the down- 
state. When the parameter J is relatively large, the injected inward current J dominates, and 
the system has one equilibrium in the intermediate voltage range — the up-state. When the 
parameter J is in neighborhood of J = 6, the system exhibits bistability of the up-state and 
the down-state. The states appear and disappear via saddle-node bifurcations. The behavior 
of the Ixjr-model is conceptually (and qualitatively) similar to the behavior of the Ina,»-model 
(3.5) even though the models have completely different ionic mechanisms for bistability. 


The equilibrium satisfies the one-dimensional equation 


0 =I-gxnd,(V)(V — Ex) — gnam3,(V)hoo(V)(V — Ena) — gu(V — Ex), 


Solutions to Exercises, chapter 3 


445 


Bifurcation Diagram 


Unstable 
equilibria an Se 

1 ay 

+71al Ty, 
‘\ Saddle-node 
) (fold) 
bifurcation 

4 —7/al 
Stable a 
equilibriua E= : 


2 ae 0 05 1 


~~” Representative Phase Portraits ~~ 


15 15 1.5 
¢ 


x x ate, x 
1 ape , ; ane 
0.5 0.5 0.5 
Xx x x 
0 > —_— 0 > —_ 0;--—>_- >_>} 
0.5 -0.5 0.5 
1 1 1 
2 1 0 1 2 -2 1 0 1 2 2 1 0 1 2 
a=-1 a=0 a=0.5 


Figure $.5: Saddle-node (fold) bifurcation diagram and representative phase portraits of the system 
& =a+4 2? (see chapter 3, exercise 6). 


11. 


12. 


13. 


14. 


where all gating variables assume their asymptotic values. The solution 
T= gxns(V)(V — Ex) + gnams,(V)Roo(V)(V — Ena) + L(V — Ex) 


is depicted in Fig.S.9. Since the curve in this figure does not have folds, there are no saddle-node 
bifurcations in the Hodgkin-Huxley model (with the original values of parameters). 


The curves 
(a) gu (V) = —gnaMoo(V)(V — Ena)/(V — Ex) 

and 

(b) EL(V) =V + gramao(V)(V — Ena)(V — Ex)/9n 
are depicted in Fig.S.7. 
The curves 

(a) gt (V) = {1 — gxirhoo(V)(V — Ex)}/(V — Ex) 

and 

(b) — gxir(V) = {1 — gi (V — Ex.) }/{hoo(V)(V — Ex)} 


are depicted in Fig.S.10. Note that the curve in Fig.S.10a does not have the S shape. 


F'(V) = —g1 — 9xm,(V) — 9x4ms,(V)my,(V)(V — Ex) <0 


because gy > 0, Mao(V) > 0, m4, (V) > 0, and V — Ex > 0 for all V > Ex. 


F'(V) = —gr — gnhtoo(V) — guhi.(V)(V — En) < 0 


because gy > 0, hao(V) > 0, but hh, (V) < 0 and V — Ey < 0 for all V < Ey. 
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Figure $.6: Pitchfork bifurcation diagram and representative phase portraits of the system ¢ = 
bx — x? (see chapter 3, exercise 8). 
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Figure S.7: Bifurcation diagrams of the INa,p-model (3.5) with bifurcation parameters (a) gr, and 
(b) Ey, (see chapter 3, exercise 11). 
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Monostability Bistability Monostability 
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“204 ~ oxo 4 
z ao 
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70 ; the Iixj-model (3.11). 
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Figure $.9: Dependence of the position of equilibrium in the Hodgkin-Huxley model on the injected 


DC current; see exercise 10. 


15. When V is sufficiently large, V ~ V2. The solution of V = V? is V(t) = 1/(c — t) (check by 
differentiating), where c = 1/V(0). Another way to show this is to solve (3.9) for V and find 
the asymptote of the solution. 


3 3 


16. Each equilibrium of the system + = a + bx — x” is a solution to the equation 0 = a+ ba — 2”. 
Treating z and b as free parameters, the set of all equilibria is given by a = —bx + x, and it 
looks like the cusp surface in Fig.6.34. Each point where the cusp surface folds, corresponds to 
a saddle-node (fold) bifurcation. The derivative with respect to x at each such point is zero; 
alternatively, the vector tangent to the cusp surface at each such point is parallel to the x-axis. 
The set of all bifurcation points is projected to the (a, b)-plane at the bottom of the figure, and 
it looks like a curve having two branches. To find the equation for the bifurcation curves, one 
needs to remember that each bifurcation point satisfies two conditions: 


e It is an equilibrium; that is, a + bx — 2° = 


e The derivative of a + bx — x? with respect to x is zero; that is, b — 3x”? = 0. 


Solving the second equation for x and using the solution z = +,/b/3 in the first equation yields 
a = ¥2(b/3)3/?. The point a = b = 0 is called a cusp bifurcation point. 
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Figure 5.10: Bifurcation diagrams of the I¢j,-model (3.11), J = 6, with bifurcation parameters (a) 
gt and (b) gxir (see chapter 3, exercise 12). 


17. (Gradient systems) For V = F(V) take 


where c is any constant. 


a. E(V)=1 b. E(V)=-V c. E(V) =V?/2 
d. E(V)=V-V3/3 e E(V)=—-V7/24+V4/4 £ E(V)=—cosV 


18. (c) implies (b) because |x(t) — y| < exp(—at) implies that 2(t) > y as t > oo. (b) implies (a) 
according to the definition. 


(a) does not imply (b) because «(t) may not approach y. For example, y = 0 is an equilibrium in 
the system « = 0 (any other point is also an equilibrium). It is stable, since |x(t) —0] < ¢ for all 
|zo—0| < ce and allt > 0. However, it is not asymptotically stable because lim;_,.. x(t) = rg 4 0 
regardless of how close xo is to 0 (unless xo = 0). 


(b) does not imply (c). For example, the equilibrium y = 0 in the system « = —2x? is asymp- 
totically stable (check by differentiating that x(t) = (2t+a9°)~'/? — 0 is a solution with 
x(0) = 29); however, x(t) approaches 0 with a slower than exponential rate, exp(—at), for any 
constant a > 0. 


Solutions for chapter 4 
1. See figures $.11-S.15. 
2. See Fig.S.16. 
3. See figures $.17-S.21. 


4. The diagram follows from the form of the eigenvalues 
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Figure $.11: Nullclines of the vector field; see also Fig.S.17. 
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Figure $.12: Nullclines of the vector field; see also Fig.S.18. 
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Figure $.13: Nullclines of the vector field; see also Fig.S.19. 
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Figure $.15: Nullclines of the vector field; see also Fig.S.21. 


If A < 0 (left half-plane in Fig.4.15), then the eigenvalues have opposite signs. Indeed, 


V7? —4A > V7? = |r], 


whence 


T—vVT?-4A <0. 


The equilibrium is a saddle in this case. Now consider the case A > 0. When 7? < 4A (inside 
the parabola in Fig.4.15), the eigenvalues are complex-conjugate; hence the equilibrium is a 
focus. It is stable (unstable) when 7 < 0 (tr > 0). When 7? > 4A (outside the parabola in 
Fig.4.15), the eigenvalues are real. Both are negative (positive) when 7 < 0 (7 > 0). 


TH+ —4A>0 and 


(van der Pol oscillator) The nullclines of the van der Pol oscillator, 


y=a2—2°/3 (x-nullcline) , 


x=0 (y-nullcline) , 


are depicted in Fig.S.22. There is a unique equilibrium (0,0). The Jacobian matrix at the 
equilibrium has the form 
1 -l 
ie ( -_ ) | 


Since tr L = 1 > 0 and det L = b > 0, the equilibrium is always an unstable focus. 
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6. 


Figure 5.16: Approximate directions of the vector in each region between the nullclines. 


(Bonhoeffer—van der Pol oscillator) The nullclines of the Bonhoeffer—van der Pol oscillator with 
c = 0 have the form 


y=ax—2°/3 (a-nullcline) , 
x=a_ (y-nullcline) , 


shown in Fig.S.23. They intersect at the point = a, y = a —a°/3. The Jacobian matrix at 
the equilibrium (a,a— a°/3) has the form 


1-—a? -1 
r=(15° @). 
Since tr L = 1—a? and det L = b > 0, the equilibrium is a stable (unstable) focus when |a| > 1 
(\a| < 1), as we illustrate in Fig.S.23. 


. (Hindmarsh-Rose spiking neuron) The Jacobian matrix at the equilibrium (Z, 7) is 


af fF 4 
ae —1 ? 
trL=f'-1 and det L =—f' +g’. 


The equilibrium is a saddle (det L < 0) when g’ < f’, that is, in the region below the diagonal 
in Fig.$.24. When g’ > f’, the equilibrium is stable (tr L < 0) when f’ < 1, which is the left 
half-plane in Fig.S.24. Using the classification in Fig.4.15, we conclude that it is a focus when 
(f’ — 1)? — 4(g’ — f’) <0, that is, when 


therefore 


1 
g > rica iy, 
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Figure $.17: Left: No equilibria. Right: Saddle equilibrium. 
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Figure $.19: Left: Excitable system having one stable equilibrium. Right: Two stable nodes 
separated by a saddle equilibrium. 
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Figure 8.20: 


limit cycle. 


Figure 8.21: 
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Figure $.22: Nullclines and phase portrait of the van der Pol oscillator (b 


= 0.1). 
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Left: Saddle-node equilibrium. Right: Stable node and saddle equilibria connected by 
two heteroclinic trajectories, which form an invariant circle with an unstable focus inside 
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Figure $.23: Nullclines and phase portrait of the Bonhoeffer-van der Pol oscillator (b = 0.05 and 
c=0). 
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Figure $.24: Stability diagram of 
the Hindmarsh-Rose spiking neuron 
i 7 7 : ; : : model; see exercise 7. 


stable node 


which is the upper part of the parabola in Fig.S.24. 


8. (Ik-model) The steady-state LV relation of the Ix-model is monotone; hence it has a unique 


equilibrium, which we denoted here as (V,m) € R?, where V > Ex and m= m.(V). The 
Jacobian at the equilibrium has the form 


i= ( —(g. + 9xm')/C  —49xm3(V — Ex)/C ) 
ms.(V)/T(V) atv) 


with the signs 


Obviously, det L > 0 and tr LZ < 0; hence the equilibrium (focus or node) is always stable. 


9. (In-model) The steady-state I-V relation of the I,-model is monotone; hence it has a unique 


equilibrium denote here as (V,h) € R?, where V < Ey, and h = h,.(V). The Jacobian at the 
equilibrium has the form 


Be ( =(o5 + gnh)/C —m(V — Ey)/C ) 
n(W)/r(V) —/r(V) Od 


with the signs 
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Figure $.25: The left equilibrium is stable when x < c/2; see exercise 11. 


Obviously, det L > 0 and tr L < 0; hence the equilibrium is always stable. 
10. (Bendixson’s criterion) The divergence of the vector field of the Ix-model 
Of (x,y)/Ox Og(a,y)/Oy 
~ 4 . 
(—9 — g«m")/C + —1/r(V) 
is always negative; hence the model cannot have a periodic orbit. Therefore, it cannot have 


sustained oscillations. 


11. The z-nullcline is y = a+ 2? and the y-nullcline is y = ba/c, as in Fig.S.25. The equilibria 


(intersections of the nullclines) are 

b/c+ (b/c)? — 4a 
9 ? 

provided that a < $(b/c)?. The Jacobian matrix at (Z,y) has the form 


2% —1 
a) 


det L = —2%c +b = =v b? — 4ac? . 
Thus, the right equilibrium (i.e., (b/c + \/ (b/c)? — 4a)/2) is always a saddle and the left equi- 
librium (i.e., (b/c — \/(b/c)? — 4a)/2) is always a focus or a node. It is always stable when it 
lies on the left branch of the parabola y = a + 2? (i.e., when Z < 0), and also can be stable on 
the right branch if it is not too far from the parabola knee (i.e., if Z < c/2); see Fig.S.25. 


y = bz/c, 


— 


with tr L = 2% — c and 


Solutions for chapter 5 


1. The J,-model with instantaneous activation has the form 


leak Jj, In 
CV = 1 gL (V E,) GAMoo(V)A(V = Ex) 


h = (heo(V)—h)/r(V). 
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Figure $.26: Answer to exercise 2. 
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Figure $.27: The saddle-node bifurcation diagrams of the Iya¢- and [4-minimal models. 


To apply the Bendixson criterion (chapter 4, exercise 10), we first determine the divergence of 


this vector field 
dV Oh 


av + apm hg + Gamo (VA(V — Ex) + Gameo(V)h}/C - 1/r(V) <0. 


Since it is always negative, the J,-model cannot have limit cycle attractors (or any other closed 


loop orbit). 


. See Fig.S.26. 


. The curves 


I= gL(V — Ey) + gnam3,(V)hoo(V)(V — Ena) 


and 


I= gt (V — Ey) + gamo(V) Roo(V)(V — Ex) 


are depicted in Fig.S.27. 


. g is not an absolute conductance, but is taken relative to the conductance at the resting state. 


Negative values occur because the initial holding voltage value in the voltage-clamp experiment 
described in Fig.5.22a corresponds to the resting potential, at which the Kt conductance is 
partially activated. Indeed, in the INa,p+Jk-model the K* gating variable n ~ 0.04; hence 
the K* conductance is approximately 0.4 (because gx = 10). According to the procedure, 
this value corresponds to g = 0. Any small decrease in conductance would result in negative 
values of g. If the initial holding voltage were very negative, say below —100 mV, then the slow 
conductance g would have nonnegative values in the relevant voltage range (above —100 mV). 
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5. The curve Isiow(V) defines slow changes of the membrane voltage. The curve I—TItast(V) defines 
fast changes. Its middle part, which has a positive slope, is unstable. If the I-V curves intersect 
in the middle part, the equilibrium is unstable, and the system exhibits periodic spiking: The 
voltage slowly slides down the left branch of the fast I-V curve toward the slow I-V curve 
until it reaches the left knee, and then jumps quickly to the right branch. After the jump, the 
voltage slowly slides up the right branch until it reaches the right knee, and then quickly jumps 
to the left branch along the straight line that connects the knee and the point (Ex,0) (see 
also previous exercise). Note that the direction of the jump is not horizontal, as in relaxation 
oscillators, but along a sloped line. On that line the slow conductance g is constant, but the 
slow current Isiow(V) = g(V — Ex) changes quickly because the driving force V — Ex changes 
quickly. When the I-V curves intersect at the stable point (negative slope of I — Itast(V)), the 
voltage variable may produce a single action potential, then slide slowly toward the intersection, 
which is a stable equilibrium. 


Solutions for chapter 6 


1. There are two equilibria: « = 0 and x = b. The stability is determined by the sign of the 
derivative 


A = (a(b—2))), = b- 2x 


at the equilibrium. Since \ = b when x = 0, this equilibrium is stable (unstable) when b < 0 
(b > 0). Since \ = —b when x = 8, this equilibrium is unstable (stable) when b < 0 (b > 0). 


2. (a) The system 
& = ba? , b#0 


cannot exhibit saddle-node bifurcation: It has one equilibrium for any nonzero b, or an 
infinite number of equilibria when b = 0. The equilibrium xz = 0 is non-hyperbolic, 
and the non-degeneracy condition is satisfied (a = b £ 0). However, the transversality 
condition is not satisfied at the equilibrium x = 0. Another example is ¢ = b? + 2?. 


(b) The system 


t=b-—x7° 


has a single stable equilibrium for any b. However, the point « = 0 is non-hyperbolic when 
b = 0 and the transversality condition is also satisfied. The non-degeneracy condition is 
violated, however. 


3. It is easy to check (by differentiating) that 


b Bsn 
V(t) = ee tan(./ac(b — Osn)t) 
is a solution to the system. Since tan(—7/2) = —oo and tan(+7/2) = +00, it takes 
a a 
ac(b — bgn) 


for the solution to go from —oo to +00. 


4. The first system can be transformed into the second if we use complex coordinates z = u + iv. 
To obtain the third system, we use polar coordinates 


re? =z=utiweEC, 
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5. 


6. 
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so that 
7 (c(b)+1w(b)) z+(atld)z|z2|? 
re? + rel?ig = (c(b) + iw(b))rel? + (a+ id)r?el? . 


Next, we divide both sides of this equation by el? and separate the real and imaginary parts 
to obtain 


{* — c(b)r — ar?} + ir{g — w(b) — dr?} =0, 
which we can write in the polar coordinates form. 
(a) The equilibrium r = 0 of the system 
- = br 


ie 


9 


has a pair of complex-conjugate eigenvalues +i for any b, and the non-degeneracy con- 
dition is satisfied for any b £ 0. However, the transversality condition is violated, and 
the system does not exhibit Andronov-Hopf bifurcation (no limit cycle exists near the 
equilibrium). 


(b) The equilibrium r = 0 for b=0 
r = or 


Us nies Ws 


has a pair of complex-conjugate eigenvalues +i and the transversality condition is satis- 
fied. However, the bifurcation is not of the Andronov-Hopf type because no limit cycle 
exists near the equilibrium for any b. 


The Jacobian matrix at the equilibrium (u,v) = (0,0) has the form 


b -1 
= ( oo ) | 
It has eigenvalues b+1. Therefore, the loss of stability occurs at b = 0, and the non-hyperbolicity 
and transversality conditions are satisfied. Since the model can be reduced to the polar- 


coordinate system (see exercise 4) and a 4 0, the non-degeneracy condition is also satisfied, 
and the system undergoes an Andronov-Hopf bifurcation. 


Since 
c+3]c| when a> 0, 


3\r 2 = 
(er + ar’)), = c+ 3ar = e+ 3ale/al = { c—3|c| whena <0, 


the limit cycle is stable when a < 0. 


The sequence of bifurcations is similar to that of the RS neuron in Fig.8.15. The resting 
state is a globally asymptotically stable equilibrium for I < 5.64. At this value a stable 
(spiking) limit cycle appears via a big saddle homoclinic orbit bifurcation. At I = 5.8 a 
small-amplitude unstable limit cycle is born via another saddle homoclinic orbit bifurcation. 
This cycle shrinks to the equilibrium and makes it lose stability via subcritical Andronov-Hopf 
bifurcation at J = 6.5. This unstable focus becomes an unstable node when I increases, and 
then it coalesces with the saddle (at J = 7.3) and disappears. Note that there is a saddle-node 
bifurcation according to the I-V relation, but it corresponds to the disappearance of an unstable 
equilibrium. 
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9. 


10. 


11. 


12. 


The Jacobian matrix of partial derivatives has the form 
re —hWi2) -EV,2) 
“ete VOY). Yar) yp? 
so that 
tr L = —{I,(V,x) +1/r(V)} 
and 
det L = {I,(V, x) + EV, 2)x,,(V)}/1(V) = 1.(V)/r{(V) . 
The characteristic equation 
MW —AtrL+det L=0 
has two solutions , 
pee OOO Os 
(tr L)/2+/{(tr L)/2}2 — det L 


which might be complex-conjugate. 


Let z= reel. then 


—— ar+r3—r>, 


/ 


p= wu. 
Any limit cycle is an equilibrium of the amplitude equation, that is, 
at+tr?7—r*=0. 


The system undergoes fold limit cycle bifurcation when the amplitude equation undergoes a 
saddle-node bifurcation, that is, when 


a+3r? —5r4+=0 


(check the non-degeneracy and transversality conditions). The two equations have the non- 
trivial solution (a,r) = (—1/4, 1/2). 


The projection onto the vj-axis is described by the equation 
E=AL, x(0) =a. 


The trajectory leaves the square when x(t) = ae*!* = 1; that is, when 


1 1 
i= ae a Ty) . 


Equation (6.13) has two bifurcation parameters, b and v, and the saddle-node homoclinic 
bifurcation occurs when b = bs, and v = Vgy. The saddle-node bifurcation curve is the straight 
line b = ben (any v). This bifurcation is on an invariant circle when v < Vz, and off otherwise. 
When 6b > bsn, there are no equilibria and the normal form exhibits periodic spiking. When 
b < bsn, the normal form has two equilibria, 


node saddle 
evo naa———ae_—saw~waan 
Ven — Vclb — bsn|/a and Ven + Vclb — bsn|/a . 


The saddle homoclinic orbit bifurcation occurs when the voltage is reset to the saddle, that is, 
when 
v = Ven + Vclb — bsn|/a . 
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13. 


14. 


15. 


16. 


17. 


18. 
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The Jacobian matrix at an equilibrium is 


Saddle-node condition det L = —2va + ab = 0 results in v = b/2. Since v is an equilibrium, 
it satisfies v? — bv + I = 0; hence b? = 47. The Andronov-Hopf condition tr L = 2v —a = 0 
results in v = a/2; hence a?/4 — ab/2+I = 0. The bifurcation occurs when det L > 0, 
resulting in a < b. Combining the saddle-node and Andronov-Hopf conditions results in the 
Bogdanov-Takens conditions. 


Change of variables (6.5), v = 2 and u = ,/py, transforms the relaxation oscillator into the 


form 

Ly = , 7 

aoe P(x) ~ Viy with the Jacobian L = ( END hee ) 

y = Vale—b) VE 0 
at the equilibrium v = 2 = b, u = \/pfy = f(b). The Andronov-Hopf bifurcation occurs when 
tr L = f’(b) = 0 and det L = p > 0. Using (6.7), we find that it is supercritical when f’’(b) < 0 
and subcritical when f’”’(b) > 0. 


The Jacobian matrix at the equilibrium, which satisfies F'(v) — bu = 0, is 


Fv -1 
L= ‘ 
( ub —p ) 
The Andronov-Hopf bifurcation occurs when tr L = F’ — u = 0 (hence F” = yw) and det L = 


w? = pb — yw? > 0 (hence b > ys). The change of variables (6.5), v = x and u = px + wy, 
transforms the system into the form 


&é = -wy + f(x) 
y = WL ae g(x), 


where f(x) = F(a) — pax and g(x) = pba — F(x)]/w. The result follows from (6.7). 


The change of variables (6.5) converts the system into the form 


& = F(a) + linear terms 
y = p(G(a)— F(ax))/w + linear terms. 


The result follows from (6.7). 
The change of variables (6.5), v = x and u = pa + wy, converts the system into 


& = F(«x)—2(ux+wy) + linear terms 
y G(x) — F(@) + e(ua + wy)]/w. 


I 


The result follows from (6.7). 


The system undergoes Andronov-Hopf bifurcation when F, = —wG, and Fy,Gy < —pG?. We 
perform all the steps from (6.4) to (6.7), disregarding linear terms (they do not influence a) 
and the terms of the order o(u). Let w = /—pFyG, + O(u), then u = (uGyx — wy)/Fy = 
—wy/F,, + O(n), and 


f(x,y) = F(z, —wy/ Fy ae O(u)) = F(x,0) 3 F(x, O)wy/Fr + O(p) 


and 
g(@,y) = (u/w)[GuF (x, 0) — FuG(x, 0)] + O(n) . 


The result follows from (6.7). 
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Figure $.28: Codimension-2 Shilnikov-Hopf bifurcation. 


Solutions for chapter 7 


1. Take c < 0 so that the slow w-nullcline has a negative slope. 


2. The quasi-threshold contains the union of canard solutions. 


3. The change of variables z = e!“'u transforms the system into the form 


461 


which can be averaged, yielding 


Apparently, the stable equilibriu 
elwt T* ( w) . 


i= ef-ute™7(@)}, 


u=e{-ut+I*(w)}. 


m u = I*(w) corresponds to the sustained oscillation z = 


4. The existence of damped oscillations with frequency w implies that the system has a focus 


equilibrium with eigenvalues —e 4 
represented in the form (7.3). Th 


t iw, where ¢ > 0. The local dynamics near the focus can be 
e rest of the proof is the same as the one for exercise 3. 


5. Even though the slow and the fast nullclines in Fig.5.21 intersect in only one point, they 


continue to be close and parallel 
proximity creates a tunneling effe 
those nullclines. 


to each other in the voltage range 10 mV to 30 mV. Such a 
ct (Rush and Rinzel 1996) that prolongs the time spent near 


6. (Shilnikov-Hopf bifurcation) The model is near a codimension-2 bifurcation having a homoclinic 
orbit to an equilibrium undergoing subcritical Andronov-Hopf bifurcation, as we illustrate in 
Fig.S.28. Many weird phenomena can happen near bifurcations of codimension-2 or higher. 


Solutions for chapter 8 


1. Consider two coupled neurons firi 


2. The equation 


ng together. 


V =c(b— ben) + a(V — Ven)? 


can be written in the form 


V= a(V — Vrest )(V — Vihresh ) 


with 


Vrest oe Von _ C(bsn _ b)/a and Vihresh oa Von = V C(bsn —_ b)/a, 


provided that b < dgn. 
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. The system v = b+v? with b > 0 and the initial condition v(0) = vyeset has the solution (check 


by differentiating) 


v(t) = Vbtan(V0(t + to)), 


where 


From the condition v(T’) = vpeak = 1, we find 


T : ata ! t d ( ata s ata nice ) 
= n = n—— n ; 
vb vo” OV vb vb 


which alternatively can be written as 


1 Ureset — 1 
T = —at b ——— _] . 
Vb ae (vo Vreset a ;) 


. The system + = —|b| + v? with the initial condition v(0) = Uyesct > +/|b| has the solution (check 


by differentiating) 
deh gtv oer te) 


1 — e2Vb(t+to) ’ 


v(t) = Vb) 


where 
1 Ureset — |D| 


to = n : 
m 2,/Jb] Ureset + Jb 


From the condition v(T) = 1, we find 


r 1 1 1—,/|b| in Ureset = |D| 
= n n . 
24/ |D| 1l+y¥ |b| Ureset 1 |b| 


. The saddle-node bifurcation occurs when b = 0, regardless of the value of Vyeset, which is a 


straight vertical line in Fig.8.3. If vreser < 0, then the saddle-node bifurcation is on an invariant 
circle. When b < 0, the unstable node (saddle) equilibrium is at v = \/|b|. Hence, the saddle 
homoclinic orbit bifurcation occurs when Vreset = / |b]. 


. The change of variables v = g/2+V, b = 9?/4+ B transforms # = b— gu+v?2 toV =B+V? 


with Vreset = —0o and Vpcak = +00. It has the threshold V = WB, the rheobase B = 0, and 
the same F-I curve as in the original model with g = 0. In v-coordinates, the threshold is 
v = g/2+./b— g2/4, which is greater than Vb, the new rheobase is b = g?/4, which is greater 
than b = 0, and the new F-I curve is the same as the old one, just shifted to the right by g?/4. 


. Let b=er with e < 1 be a small parameter. The change of variables 


0 

v= Je tan 3 

uniformly transforms (8.2) into the theta-neuron form 
b= Ve{(1—cos¥) + (1+ cos¥)r} . 


on the unit circle except for the small interval |) — | < 2¥/e corresponding to the action 
potential (v > 1); see Hoppensteadt and Izhikevich (1997) for more details. 
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8. Use the change of variables 


__veo 
f= 


v 
To obtain other theta neuron models, use the change of variables 
v= Veh(V) , 


where the monotone function h maps (—7,7) to (—co,oo) and scales like 1/(0 + 7) when 
Y — +7. The corresponding model has the form 


0! = h2(9)/h' (9) + r/h'(0) « 


In particular, h?(0)/h’(%) exists, and is bounded and 1/h’(9) = 0 when 3 4 +7. These imply 
a uniform velocity independent from the input r when v passes the value +7 corresponding to 
firing a spike. 


9. The equilibrium v = I/(b+1),u = bI/(b + 1) has the Jacobian matrix 


-1 -l 
eo ( ab —a ) 
with trl = —(a+1) and detL = a(b+1). It is a stable node (integrator) when b < (a+ 
1)?/(4a) — 1 and a stable focus (resonator) otherwise. 
10. The quadratic integrate-and-fire neuron with a dendritic compartment 
Vi = B+V?+4+9(Va—V) 
Va = Geak(Pieak — Va) + g2(V — Va) 


can be written in the form (8.3, 8.4), with v = V — g,/2, u=—giVa, I = B — g?/4 — (92.92 + 
JicakE\eak)/(Jleak + 92), @ = Jeak + 92, and b = —gig2/a. 


11. A MATLAB program generating the figure is provided on the author’s Web page (www. izhikevich.com). 
12. An example is in Fig.S.29. 
13. An example is in Fig.S.30. 


Solutions for chapter 9 
1. (Planar burster) Izhikevich (2000a) suggested the system 


x — x°/3 —u+49(zx) cos 40u, 
= pe, 


with S(a) = 1/(1+ e5(-*)) and = 0.01. It has a hedgehog limit cycle depicted in Fig.S.31. 


2. (Noise-induced bursting) Noise can induce bursting in a two-dimensional system with coexis- 
tence of resting and spiking states. Indeed, noisy perturbations can randomly push the state 
of the system into the attraction domain of the resting state or into the attraction domain of 
the limit cycle attractor, as in Fig.S$.32. The solution meanders between the states, exhibiting 
a random bursting pattern as in Fig.9.55 (right). Neocortical neurons of the RS and FS types, 
as well as stellate neurons of the entorhinal cortex, exhibit such bursting; see chapter 8. 
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Figure $.29: Comparison of in vitro recordings of a fast spiking (FS) interneuron of 
layer 5 rat visual cortex with simulations of the simple model with linear slow nullcline 


200 = (v + 55)(v + 40) —ut I, & = 0.15{8(u + 55) — u}, if v > 25, then v + —55, 
u << ut 200. 
3. (Noise-induced bursting) Bursting occurs because noisy perturbations push the trajectory into 


and out of the attraction domain of the limit cycle attractor, which coexists with the resting 
equilibrium; see the phase portrait in Fig.S.33. 


(Rebound bursting in the FitzHugh-Nagumo oscillator) The oscillator is near the fold limit cycle 
bifurcation. The solution makes a few rotations along the ghost of the cycle before returning 
to rest; see Fig.S.34. 


Yes, they can, at the end of a burst. Think of a “fold/Hopf” or “circle/Hopf” burster. The 
resting equilibrium is a stable focus immediately after the termination of a burst, and then it is 
transformed into a stable node to be ready for the circle or fold bifurcation. Even “circle/circle” 
bursters can exhibit such oscillations, if the resting equilibrium turns into a focus for a short 
period of time somewhere in the middle of a quiescent phase. In any case, the oscillations 
should disappear just before the transition to the spiking state. 


. (Hopf/Hopf bursting) Even though there is no coexistence of attractors, there is a hysteresis 


loop due to the slow passage effect through the supercritical Andronov-Hopf bifurcation; see 
Fig.S.35. The delayed transition to spiking creates the hysteresis loop and enables bursting. 


. (Hopf/Hopf canonical model) First, we restrict the fast subsystem to its center manifold and 


transform it into the normal form for supercritical Andronoy-Hopf bifurcation, which after 
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Figure $.30: Comparison of in vitro recordings of a regular spiking (RS) neuron with 
simulations of the simple model 1000 = J — 5(v+60) +3(v+50)% —u, & = 0.02{—2(u+ 
60) — u}, if v > 35, then vu + —50, u+ ut 70. 
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Figure $.31: Solution to exercise 1. 
Nullclines, a hedgehog limit cycle, and 
a bursting solution of a planar system. 
(Modified from Izhikevich 2000a.) 
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Figure 8.32: Noise-induced bursting 
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Figure $.33: Noise-induced bursting in a two-dimensional system with coexistence of an equilibrium 
and a limit cycle attractor; see exercise 3. 
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Figure $.34: Rebound bursting in the FitzHugh-Nagumo oscillator; see exercise 4. 
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Figure $.35: Hopf/Hopf bursting without coexistence of attractors; see exercise 6. (Modified from 
Hoppensteadt and Izhikevich 1997.) 


10. 


appropriate re-scaling, has the form 
z= (u+iw)z—zlz|’. 
Here, wu is the deviation from the slow equilibrium uo. The slow subsystem 


wu = pg(zel”! + complex-conjugate, u) 


can be averaged and transformed into the canonical form. 


(Bursting in the INat+JNa,slow-model) First, determine the parameters of the INa,4-model corre- 
sponding to the subcritical Andronov-Hopf bifurcation, and hence the coexistence of the resting 
and spiking states. Then, add a slow high-threshold persistent Nat current that activates dur- 
ing spiking, depolarizes the membrane potential, and stops the spiking. During resting, the 
current deactivates, the membrane potential hyperpolarizes, and the neuron starts to fire again. 


Replace the slow Nat current in the exercise above with a slow dendritic compartment with den- 
dritic resting potential far below the somatic resting potential. As the dendritic compartment 
hyperpolarizes the somatic compartment, the soma starts to fire (due to the inhibition-induced 
firing described in section 7.2.8). As the somatic compartment fires, the dendritic compartment 
slowly depolarizes, removes the hyperpolarization and stops firing. 


(Bursting in the INap+JK+Ina,slow-model) The time constant Tslow(V) is relatively small in the 
voltage range corresponding to the spike after-hyperpolarization (AHP). Deactivation of the 
Na* current during each AHP is much stronger than its activation during the spike peak. As 
a result, the Na* current deactivates (turns off) during the burst, and then slowly reactivates 
to its baseline level during the resting period, as one can see in Fig.S.36. 
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Figure 5.36: Bursting in the INa,ptJk+JNa,slow-model. See exercise 10. 


slow increase of | fast increase of | 


Spiking 


Figure $.37: The system has a unique attractor, equilibrium, yet it can exhibit repetitive spiking 
activity when the N-shaped nullcline is moved upward not very slowly. 


11. 


12. 


The mechanism of spiking, illustrated in Fig.$.37, is closely related to the phenomenon of 
accommodation and anodal break excitation. The key feature is that this bursting is not 
fast-slow. 

The system has a unique attractor — a stable equilibrium — and the solution always converges 
to it. The slow variable J controls the vertical position of the N-shaped nullcline. If J increases, 
the nullcline slowly moves upward, and so does the solution, because it tracks the equilibrium. 
However, if the rate of change of I is not small enough, the solution cannot catch up with the 
equilibrium and starts to oscillate with a large amplitude. Thus, the system exhibits spiking 
behavior even though it does not have a limit cycle attractor for any fixed I. 


From the first equation, we find the equivalent voltage 


2 _ jf l+u ifl+u>0, 
P= W+ule={ 4 ifltu<o, 


so that the reduced slow subsystem has the form 


“= plu— ue — wv), 
= pli +ul,—1, 


and it has essentially the same dynamics as the van der Pol oscillator. 
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13. 


14. 


15. 


16. 


Saddle-Node on 
Invariant Circle 
Bifurcation 
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Figure $.38: Answer to exercise 13. 


The fast equation 


J) =1—cos0 + (1+cos¥)r 
is the Ermentrout-Kopell canonical model for Class 1 excitability, also known as the theta 
neuron (Ermentrout 1996). It is quiescent when r < 0 and fires spikes when r > 0. As W 
oscillates with frequency w, the function r = r(w) changes sign. The fast equation undergoes a 
saddle-node on invariant circle bifurcation; hence the system is a “circle/circle” burster of the 
slow-wave type; see Fig.5.38. 


To understand the bursting dynamics of the canonical model, rewrite it in polar coordinates 
2=re'?: 

ro = urt+2re—r?, 

“i= ula ~~ 7) ’ 

p= w. 


Apparently, it is enough to consider the first two equations, which determine the oscillation 
profile. Nontrivial (r 4 0) equilibria of this system correspond to limit cycles of the canonical 
model, which may look like periodic (tonic) spiking with frequency w. Limit cycles of this 
system correspond to quasi-periodic solutions of the canonical model, which look like bursting; 
see Fig.9.37. 


The first two equation above have a unique equilibrium, 


r\ Ja 

uj} \ a®—2a 
for all and a > 0, which is stable when a > 1. When a decreases and passes an pz neighborhood 
of a = 1, the equilibrium loses stability via Andronov-Hopf bifurcation. When 0 < a < 1, the 
system has a limit cycle attractor. Therefore, the canonical model exhibits bursting behavior. 


The smaller the value of a, the longer the interburst period. When a > 0, the interburst period 
becomes infinite. 


Take w = I —u. Then (9.7) becomes 


vtw, 
= pl—-w)eyul. 


v 


Let us sketch the derivation. Since the fast subsystem is near saddle-node homoclinic orbit 
bifurcation for some u = ug, a small neighborhood of the saddle-node point vp is invariantly 
foliated by stable submanifolds, as in Fig.S5.39. Because the contraction along the stable sub- 
manifolds is much stronger than the dynamics along the center manifold, the fast subsystem 
can be mapped into the normal form # = q(u) + p(v— vo)? by a continuous change of variables. 
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Figure $.39: A small neighborhood of the saddle-node point can be invariantly foliated by stable 
submanifolds. 
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18. 
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Figure $.40: exercise 18. 


When v escapes the small neighborhood of vp, the neuron is said to fire a spike, and v is reset 
to v + v9 +c(u). Such a stereotypical spike also resets u by a constant d. If g(vo, ug) © 0, then 
all functions are small, and linearization and appropriate re-scaling yield the canonical model. 
If g(vo, uo) # 0, then the canonical model has the same form as in the previous exercise. 


The derivation proceeds as in the previous exercise, yielding 
o = I+v?+4+(a,u), 
au = pAu. 


where (a,u) is the scalar (dot) product of vectors a,u € R?, and A is the Jacobian matrix 
at the equilibrium of the slow subsystem. If the equilibrium is a node, it generically has two 
distinct eigenvalues and two real eigenvectors. In this case, the slow subsystem uncouples into 
two equations, each along the corresponding eigenvector. Appropriate re-scaling gives the first 
canonical model. If the equilibrium is a focus, the linear part can be made triangular in order 
to get the second canonical model. 


The solution of the fast subsystem 
b=utv’, v(0) = —-1, 
with fixed u > 0 is 


v(t) = Vutan (vi — atan =) : 


The interspike period, T, is defined by v(T) = +00, given by the formula 


T(u) = 7 (5 + atan =z) , 
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19. 


20. 


21. 
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Figure $.41: Classification of point-point codimension-1 hysteresis loops. 


The result follows from the integral 


1 i dy 
— d; 0(t — T(u)) dt = 
and the relationships 
f(u) = d feat Scnineet Vu 
= — r . 
u Tu) an atan a u 


Periodic solutions of the averaged system (focus case) and the full system are depicted in 
Fig.S.40. The deviation is due to the finite size of the parameters 1 and ple in Fig.9.35. 


There are only two codimension-1 bifurcations of an equilibrium that result in transitions to 
another equilibrium: saddle-node off limit cycle and subcritical Andronov-Hopf bifurcation. 
Hence, there are four point-point hysteresis loops, depicted in Fig.S.41. More details are pro- 
vided in Izhikevich (2000a). 


These figures are modified from Izhikevich (2000a), where one can find two models exhibiting 
this phenomenon. The key feature is that the slow subsystem is not too slow, and the rate 
of attraction to the upper equilibrium is relatively weak. The spikes are actually damped 
oscillations that are generated by the fast subsystem while it converges to the equilibrium. 
Periodic bursting is generated via the point-point hysteresis loop. 


There are only two codimension-1 bifurcations of a small limit cycle attractor (subthreshold 
oscillation) on a plane that result in sharp transitions to a large-amplitude limit cycle attractor 
(spiking): fold limit cycle bifurcation and saddle-homoclinic orbit bifurcation; see Fig.S.42. 
These two bifurcations paired with any of the four bifurcations of the large-amplitude limit 
cycle attractor result in eight planar codimension-1 cycle-cycle bursters; see Fig.S.43. More 
details are provided by Izhikevich (2000a). 
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Figure $.42: Codimension-1 bifurcations of a stable limit cycle in planar systems that result in 
sharp loss of stability and transition to a large-amplitude (spiking) limit cycle attractor, not shown 
in the figure. Fold limit cycle: A stable limit cycle is approached by an unstable one, they coalesce, 
and then they disappear. Saddle homoclinic orbit: A limit cycle grows into a saddle. The unstable 
manifold of the saddle makes a loop and returns via the stable manifold (separatrix). 
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Figure 8.43: Classification of codimension-1 cycle-cycle planar bursters. 
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Solutions to Chapter 10 


1. In polar coordinates, z = rel, the system has the form 


rar. 


o=1 


y] 


Since the phase of oscillation does not depend on the amplitude, the isochrons have the radial 
structure depicted in Fig.10.3. 


2. In polar coordinates, the oscillator has the form 
d=1+dr’, ror—r, 
The second equation has an explicit solution r(t), such that 


= 1 
~ 1-(1-1/r(0)2)e-2¢ 


r(t)? 


The phase difference between J}. = 1+d(1)? and J = 1+dr(t)? grows as x = d(r(t)? — 1), and 
its asymptotic value is 


x(co) =} d(r(t)? — 1) =dlogr(0) . 
0 
Thus, on the y-isochron, we have ? + dlogr = x. 


3. An example is the file isochrons.m 


function isochrons(F, phases, x0) 

% plot isochrons of a planar dynamical system x’=F(t,x) 
% at points given by the vector ’phases’. 

% ?xO? is a point on the limit cycle (2x1-vector) 

T= phases(end); % is the period of the cycle 


tau = T/600; % time step of integration 

m=200; % spatial grid 

k=5; % the number of skipped cycles 

[t,lc] = ode23s(F,0:tau:T,x0); % forward integration 
dx=(max(1c)-min(1c))’/m; % spatial resolution 

center = (max(1c)+min(1c))’/2; % center of the limit cycle 
iso=[x0-m*0.5*dx, x0+m*0.5x*dx] ; % isochron’s initial segment 
for t=0:-tau:-(k+1)*T % backward integration 


for i=1:size(iso,2) 
iso(:,i)=iso(:,i)-tau*feval(F,t,iso(:,i)); % move one step 


end; 
i=1; 
while i<=size(iso,2) % remove infinite solutions 
if any(abs(iso(:,i)-center)>1.5*m*dx) % check boundaries 
iso = [iso(:,1:i-1), iso(:,itl:end)]; % remove 
else 
i=itl; 
end; 
end; 
i=1; 


while i<=size(iso,2)-1 


ATA 
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d=sqrt (sum(((iso(:,i)-iso(:,i+1))./dx).°2)); % normalized distance 
if d>2 % add a point in the middle 

iso = [iso(:,1:1), (iso(:,i)+iso(:,i+1))/2 ,iso(:,it+t1:end)]; 
end; 
if d< 0.5 % remove the point 
iso = [iso(:,1:i1), iso(:,i+2:end)]; 
else 
i=itl; 
end; 
end; 
if (mod(-t,T)<=tau/2) & (-t<k*T+tau) %, refresh the screen 
cla;plot(1c(:,1),1c(:,2),’r’); hold on; % plot the limit cycle 
end; 
if min(abs(mod(-t,T)-phases))<tau/2 % plot the isochrons 
plot(iso(1,:),iso(2,:),’k-’); drawnow; 
end; 
end; 
hold off; 


The call of the function is isochrons(’F’ ,0:0.1:2*pi,[1;0]); with 


function dx = F(t,x); 
z=x(1)+1i*x (2); 
dz=(1+1i)*z-z*z*conj (z) ; 
dx=[real(dz); imag(dz)]; 


(Hoppensteadt and Keener 1982) From calculus, B-C = |B||C|cos(w). Since |B| = 1 and 
C = (A+cos¥,sin¥) — see Fig.10.46 — we have B- C = Acos¥ + cos?) + sin? J. Hence, 
cosy = (1+ Acos¥)/V1+ 2A cos? + A?. When ¥ is in the upper (lower) half-plane, the phase 
is delayed (advanced). 


An example is the file prc.m 


function PRC=prc(F,phases,x0,A) 

% plot phase-resetting curve (PRC) of system x’=F(t,x) + A delta(t) 
% at points given by the vector ’phases’. 

% ?x0O’ is a point on the limit cycle with zero phase 

% A is the strength of stimulation (row-vector) 

% use peaks of spikes to find the phase differences 

T= phases(end); % is the period of the cycle 


tau = T/6000; % time step of integration 
k=3; % the number of cycles needed to determine the new phase 
PRC=[] ; 


[tc,lc] = ode23s(F,0:tau:k*T,x0); % find limit cycle 
peak=1+find(1c(2:end-1,1)>1c(1:end-2,1)&1c(2:end-1,1)>=1c(3:end,1)); 
peakO = tc(peak(end)); % the last peak is used for reference 
for i=1:length (phases) 
[m, j]=min(abs (phases (i)-tc)); 
[t,x] = ode23s(F,phases(i):tau:k*T,1lc(j,:)+A); % stimulate 
peaks=1+find(x(2:end-1,1)>x(1:end-2,1)&x(2:end-1,1)>=x(3:end,1)); 
PRC=[PRC, mod(T/2+peak0-t (peaks (end) ) ,T)-T/2]; 
subplot (2,1,2) ;drawnow; 
plot (phases (1: length (PRC) ) , PRC) ; 
xlabel(’phase of stimulation’) ;ylabel(’induced phase difference’); 
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10. 


subplot (2,1,1); 
plot(tc,1lc(:,1),’r’,t,x(:,1),t(peaks(end)) ,x(peaks(end) ,1),’ro’); 
xlabel(’time’);ylabel(’membrane potential’); 

end; 


An example of a call of the function is PRC=pre(’F’ ,0:0.1:2*pi,[-1 0], [0.1 0]); with 


function dx = F(t,x); 
z=x(1)+1i*x (2); 
dz=(1+1i) *z-z*z*conj (z) ; 
dx=[real(dz); imag(dz)]; 


mad (“ + ay — oz) e+ bs = Ho) 
— ( PRC1(0(z), h1) PRC», (0(x), hm) 
= (FACE) PRCn( Oe). he)) 


(in the limit h > 0) 
Z(0(a))hy Zm(O(&))hm 
hh, baie i, 
= (Z,((x)),---,Zm(9(z))) = Z(V(z)) . 


. (Brown et al. 2004, appendix A) Let 2 be a point on the limit cycle and z be an arbitrary 


nearby point. Let «(t) and z(t) be the trajectories starting from the two points, and y(t) = 
z(t) — x(t) be the difference. All equations below are valid up to O(y?). The phase shift 
Ad’ = V(z(t)) — V(a(t)) = grad ¥(ax(t)) - y(t) does not depend on time. Differentiating with 
respect to time and taking grad 0(x(t)) = Z(v(t)) (see previous exercise), results in 


0 = (d/dt) (Z(v(t)) - y(t) = 2'(B(H) yO + Z(() - DF (@(t))ylt) 
= Z(t) - y(t) + Df (a 
= (29) + F(a) 


= ee 
N = 
S 
+S 


Since y is arbitrary, Z satisfies Z'(0) + Df(«(0))'Z(0) = 0, that is, the adjoint equation 
(10.10). The normalization follows from (10.7 


ye 
. The solution to ’ = b— v with v(0) = 0 is u(t) = b(1 — e*) with the period T = In(b/(b — 1)) 


determined from the threshold crossing v(T’) = 1. From v = b(1—e7~”) we find 9 = In(b/(b—v)), 
hence 
PRC (V) = Vnew — 0 = min {In(b/(bexp(—vV) — A), T}-—v. 


. The system } = 1+ v? with v(0) = —oo has the solution (the reader should check this by 


differentiating) v(t) = tan(t — 7/2) with the period T = m. Since t = 7/2 + atanv, we find 
PTC (¥) = 7/2 + atan[A + tan(v — 7/2)| 


and 
PRC (3) = PTC (WV) — 0 = atan[A + tan(v — 7 /2)] — (0 — 7/2). 


The system @ = b+ v? with b > 0 and the initial condition v(0) = Vyesct has the solution (the 
reader should check this by differentiating) 


v(t) = Vbtan(VO(t + to)) 
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where 

to = as atan tee 

vb vb 

Equivalently, 

pe aa 

vb vb 
From the condition v = 1 (peak of the spike), we find 
T= ! atan d to = : (aan ot — atan “se | 
vb vb vb vb vb J’ 

Hence 


1 A 
PRC (9) = Vnew — 0 = min {— atan[— + tan(VO(0 + to))| — to, T}- 8. 
(V) { Ti [ 7; (Vb(0 + to))] — to, TF 
Let ¥ denote the phase of oscillator 1. Let x, denote the phase of oscillator 2 just before 
oscillator 1 fires a spike (i.e., when 0 = 0). This spike resets y,, to PTC2(x,,). Oscillator 2 fires 
a spike when 3 = T,—PTC2(x,), and it resets J to PTC (72—PTC2(y,)). Finally, oscillator 
1 fires its spike when oscillator 2 has the phase y¥n41 = T;-—PTC1(T2—PTCa(vn)). 


[MATLAB] An example is the file adjoint .m 


function Q=adjoint(F,t,x0) 

% finds solution to the Malkin’s adjoint equation Q’ = -DF*t Q 
% at time-points t with t(end) being the period 

% ?xO’? is a point on the limit cycle with zero phase 

tran=3; % the number of skipped cycles 

dx = 0.000001; dy = 0.000001; % for evaluation of Jacobian 


Q(1,:)=feval(F,0,x0)’; % initial point; 
[t,x] = ode23s(F,t,x0); % find limit cycle 


for k=1:tran 
QClength(t) ,:)=Q(1,:); % initial point; 
for i=length(t):-1:2 % backward integration 
L = [(feval(F,t(i),x(i,:)+[dx 0])-feval(F,t(i),x(i,:)))/dx,... 
(feval(F,t(i),x(i,:)+[0 dy])-feval(F,t(i),x(i,:)))/dyl; 
Q(i-1,:) = QGi,:) + (tCi)-tGi-1))*(QGi,:) *L); 
end; 
end; 
Q = Q/(Q(1,:)*feval(F,0,x0)); % normalization 


An example of a call of the function is Q=-adjoint(’F’ ,0:0.01:2*pi, [1 0]); with 


function dx = F(t,x); 
z=x(1)+1i*x (2); 
dz=(1+1i)*z-z*z*conj (z) ; 
dx=[real(dz); imag(dz)]; 


[MATLAB] We assume that PRC (#) is given by its truncated Fourier series with unknown 
Fourier coefficients. Then, we find the coefficients that minimize the difference between pre- 
dicted and actual interspike intervals. The MATLAB file findprc.m takes the row vector of 
spike moments, not counting the spike at time zero, and the input function p(t), determines the 
sampling frequency and the averaged period of oscillation; and then calls the file prcerror.m 
to find PRC. 
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function PRC=findprc(sp, pp) 

global spikes p tau n 

% finds PRC of an oscillator theta’= 1 + PRC(theta)pp(t) 
% using the row-vector of spikes ’sp’ (when theta(t)=0) 
spikes = [0 sp]; 


P-PP; 
tau = spikes(end)/length(p) % time step (sampling period) 
n=8; % The number of Fourier terms approximating PRC 


coeff=zeros(1,2*n+1); % initial approximation 
coeff (2*n+2) = spikes(end)/length(spikes); % initial period 


coeff=fminsearch(’prcerror’ ,coeff) ; 

a = coeff (1:n) % Fourier coefficients for sin 

b = coeff(n+1:2*n) % Fourier coefficients for cos 

bO= coeff (2*n+1) % dc term 

T = coeff(2*nt+2)  % period of oscillation 

PRC=b0+sum( (ones (floor (T/tau) ,1)*a).*sin((tau:tau:T)’*(1:n)*2*pi/T) ,2)+... 
sum( (ones (floor (T/tau) ,1)*b) .*cos((tau:tau:T)’?*(1:n)*2*pi/T) ,2); 


The following program must be in the file prcerror.m. 


function err=prcerror (coeff) 
global spikes p tau n 


a = coeff(1i:n); %, Fourier coefficients for sin 
b = coeff(nt1:2*n); % Fourier coefficients for cos 
bO= coeff (2*n+1) ; % dc term 
T = coeff(2*n+2);  % period of oscillation 
err=0; 
i=1; 
clf; 
for s=2:length(spikes) 
theta=0; 


while i*tau<=spikes(s) 
PRC=bO+sum(a.*sin((1:n)*2*pi*xtheta/T))+... 
sum(b.*cos((1:n)*2*pi*theta/T) ) ; 
theta = theta + tau*(1+PRC*p(i)); 
i=itl; 
end; 
err = err + (theta-T)°2; 
subplot (2,1,1); 
plot(spikes(s),T,’r.’,spikes(s),theta,’b.’);hold on; 
end; 
axis([0 spikes(end) 0.75*T 1.25*T]) 
subplot (2,1,2); 
PRC=bO+sum( (ones(floor(T/tau) ,1)*a).*sin((tau:tau:T)’*(1:n)*2*pi/T) ,2)+... 
sum( (ones (floor (T/tau) ,1)*b) .*cos((tau:tau:T)’*(1:n)*2*pi/T) ,2); 
plot (PRC) ; 
err = (err/(length(spikes)-1))°0.5; % normalization 
text(0,mean(PRC) , [’err=’ num2str(err)]); 
drawnow; 
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16. 


1%. 


Solutions to Exercises, chapter 10 


Winfree approach: Using results of exercise 8, 


0 In b es 1 

OA” be-°-A_ be-V—A 
and setting A = 0, we obtain Z(0) = e” /b. 
Kuramoto approach: The solution is v(#) = b(1 — e~”) with T = In(b/(b—1)) and f(v(¥)) = 
be~”’. From the condition (10.7), grad (9) = 1/f(v()) = e” /b. 
Malkin approach: Df = —1; hence Q = 1- Q has the solution Q(t) = Ce’. The free constant 
C =1/b is found from the normalization condition Q(0) - (b— 0) = 1. 


Winfree approach: Using results of exercise 10 and the relation PRC=PTC—J, we obtain, 


1 


aes atan (A — cot 0) — J) = 5 
1+ (A-— cot ¥) 


OA 


and, setting A = 0, Z(0) = sin? ¥. 

Kuramoto approach: The solution is v(W) = — cot 0 with T = 7 and f(v(¥)) = 1/sin? 0. From 
the normalization condition (10.7), grad (0) = 1/f(v()) = sin? v. 

Malkin approach: Df = 2v, hence Q = 2 cot(t) - Q has the solution Q(t) = C'sin? t. The free 
constant C’ = 1 is found from the normalization condition Q(m/2) - (1 +07) = 1. 


Winfree approach: Using results of exercise 4, 


Z(d) = 0 as 14+ Acosv 


— ] ?v 
DA i oAeose-cae 


at A=0. 


Kuramoto approach: Since grad 0(a) is orthogonal to the contour line of the function U(x) at 
x (i.e., the isochron of x) and the results of exercise 1 that isochrons are radial, we obtain 
grad (v7) = (—sin¥,cos¥), using purely geometrical considerations. Since p(t) is real, we need 
to keep only the first component. 


Malkin approach: Let us work in the complex domain. On the circle z(t) = e! we obtain 
Df =i. Since Df! is equivalent to complex-conjugation in the complex domain, we obtain 


Q = 1-Q, which has the solution Q(t) = Celt. The free constant C = i is found from the 
normalization condition Q(0)*i = 1, where * means complex-conjugate. 


Alternatively, on the circle z(t) = elt, we have f(e(t)) =f (elt) = ielt, From the normalization 
condition Q(t)* f(z(t)) = 1 we find Q(t) = ie” = — sin ¥ + icos¥. 
Rescaling the state variable z = bu and the time, tT = et, we obtain the reduced system 

wu =(1+i)ut+ (-14 di)ulu|? + ep(t). 


We can apply the theory only when ¢ is small. That is, the theory is guaranteed to work in 
a very weak limit « < bVb < 1. As is often the case, numerical simulations suggest that the 
theory works well outside the guaranteed interval. Substituting u = re! into this equation, 


elo 4 reldig? = (1+ i)rel? +(-1+ di)r3el? + ep(t) , 


dividing by e!, and separating real and imaginary terms, we represent the oscillator in polar 
coordinates 


rf = r—-r +eRep(t)e? 


@ = 1+dr +elmr~'p(t)e? ‘ 
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19. 


20. 


21. 


22. 


23. 


When ¢ = 0, this system has a limit cycle attractor r(t) = 1 and 6(t) = (1+ d)t, provided that 
d#-—1. On the attractor, the solution to Malkin’s adjoint equation (10.10), 


a=-(23 3)" @ wm a (424) = 


is Q(t) = (d, 1)/(1+d). Indeed, the normalization condition results in Q2(t) = 1/(1+d). Hence, 
unique periodic solution of the first equation, Q{ = 2Q: — 2d/(1+4+ d), is Qi(t) = d/(1 4d). 
One can also use Kuramoto’s approach and the results of exercise 2. The corresponding phase 
model, 


0 =14ef{dRep(t)e 10+? +4 Imp(t)e 1449} /(d 41) , 
can be simplified via @ = (1+ d)¥ (notice the font difference) to get the result. 


(Delayed coupling) Let 0(t) = t+ y(r), where 7 = et is the slow time. Since V(t — d) = 
t—d+(r-—ed) =t—d+ (rT) + Ole), we have x, (0,(t — dij)) = 2; (t — dij + y(7)), so that 
we can proceed as in section 10.2.5, except that there is an extra term, —d;,;, in (10.16). See 
also Izhikevich (1998). 


Let x = ya — ¥1; then we have 
XY =w-—csiny. 


If Jw/c| < 1, then there are two synchronized states, x = arcsin (w/c) and y = 7 — arcsin (w/c), 
one stable and the other unstable. 


From the theorem of Hoppensteadt and Izhikevich (1997), presented in section 10.3.3, it follows 
that Kuramoto’s model is a gradient system when c¢;; = cj; and yj; = —y;;. From Ermentrout’s 
theorem presented in the same section, it follows that the synchronized state y; = y; is stable 
if, for example, all y;; = 0 and cj; > 0. 


Since the probability density function g(w) is symmetric, the averaged frequency deviation of 
the network is zero, and, rotating the coordinate system, we can make the cluster phase w = 0. 
The network is split into two populations: One oscillating with the cluster (|w| < Ar), thereby 
forming the cluster, and one drifting in and out of the cluster. The latter does not contribute 
to the Kuramoto synchronization index, because contributions from different oscillators cancel 
each other on average. In the limit n > oo, the sum (10.21) becomes the integral 


r= [deogwaw ~ | ele) g(w)dw . 
|jw|<Kr 


Next, since there are as many oscillators with positive p as with negative, the imaginary parts 
of el?) cancel each other, so that 


c= ‘ cos p(w) g(w)dw . 
|w|<Kr 
Using the condition for locking with the cluster, w = Krsiny, we change the variables in the 


integral and obtain (10.22). 


Let y = y2 — 1; then x’ = (cz —c1)H (x). The in-phase state y = 0 exists when either c; = cg 
or H(0) = 0. Since H(x) is even, H’(0) = 0, and hence it is neutrally stable in either case. 
The anti-phase state x = T/2 exists when H(T/2) = 0, and it can be exponentially stable or 
unstable, depending on the sign of H’(T'/2). 


See Izhikevich (1999), Sect IVB. 
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The exponential stability requirement is G’(0) = —2H’(0) < 0. Since 2’(t) = f(a(t)), we have 


eins LOO ew I pep ieriinn, POE) as 
TH = | Flaté)) a= | g (a(t)) dt = Ls a) dx > 0 


Integrating the latter equation by parts, or differentiating 


_1 f* _ g(t) = f@) 
A(x) = al fG— x) dt at x = 0, we obtain a Pn) g(a) dx >0. 


(Brown et al. 2004) The solution of x’ = Ax with x(0) = xo is x(t) = xoe*. The period T = 
log(A/a9)/ is found from the condition (T) = A. Hence, Q(¥) = 1/(Ax(0)) = 1/(Aroe?”) = 
ert (AX): 


Let us first consider the SNIC case ¢ = 1+ x7. The solution starting with x(0) = 2yeset has the 
form (the reader should check by differentiating) x(t) = tan(t+to), where to = atan Lyeset. The 
period should be found from the condition tan(Z' + to) = +00, and it is T = 7/2 — to. Hence, 
a(t) = tan(t+ 7/2 —T) = —cot(t —T). Now, Q(9) = 1/(14+ 2(¥)?) = 1/(1 + cot?(v — T)) = 
sin“ (v — T). 


The homoclinic case # = —1+ 2? is quite similar. The solution starting with 7(0) = 2yeset > 1 
has the form (the reader should check by differentiating) x(t) = —coth(t + to), where to = 
acoth(—Zreset) = — acoth(Zreset). The period is found from the condition — coth(T + to) = +oo 
resulting in T = —ty. Hence, z(t) = —coth(t— T). Finally, Q(8) = 1/(-1+2(¥)?) = 


1/(1 + coth?(8 — T)) = sinh? (0 — T). 
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theorem 
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